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INTRODUCTION 

This module is one In a series of training packages that have been 
designed for working with the handicapped adolescent and young adult In 
correctional settings. This particular module focuses on the Assessment of 
Exceptional Individuals , The complete set of C/SET Training Modules Includes 
information on the following topics: 

Module 1: Correctional Educatlon/TUe Cr1n«!r.al Justice System 

Module 2: Characteristics of Exceptional Populations (Juvenile and 
Adult) 

-Module 3: Overview of Special Education 

Module 4: Overview of PL 94-142 and lEPs 

Module 5: Assessment of Exceptional Individuals 

Module 6: Curriculum for Exceptional Individuals 

Module 7: Instructional Methods and Strategies 

Module 8: Vocational Special Education 

MODULE COMPONENTS 

This module has been designed as a self-contained training package. It 
contains all the info: -nation and materials necessary to conjluct training. 
Additional Information and materials can be included at the discretion of the 
trainer. 

Instruction al Design Specifications . This cover page includes the 
following iTvFormation: 

Module Title 
Competency Statement 
Rationale Statement 
Prerequisites 

Module Objectives References 

Evaluation Procedures and Criteria Handouts 

Learning Activities and Alternatives Overhead Transparency Masters 

Content Outline Training Evaluation Form 



RECOMMENDED PREPARATION PROCEDURES 

1. Review Materials. The trainer should thoroughly review the entire 
package and become familiar with the content of each component. 
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ASSESSMENT OF EXCEPTIONAL INDIVIDUAL 3. 



Conduct Needs Assessment. 

a. Type in the name and address of the trainer on the Needs 
Assessment Form. 

b. Duplicate the form and distribute to participants well in advance 
of the established training date(s). 

Note: Each item on the Needs Assessment Form corresponds to a 
major unit or section of the Content Outline as designated 
by a number, decimal, and a zero (e.g., 1.0, 2.0, 3.0). As 
such, each needs assessment question represents a very 
broad content area. 

A trainer may design a more specific needs assessmeiit 
Instrument by formulating questions related to subsections 
of the Content Outline. This is recommended when there is 
a specific pre-determined focus for training or when there 
is a limited amount of time for training. 

Review the completed Needs Assessment Forms. 

Select the topics/content to be presented. 

Formulate objectives for the training sessions. The major objectives 
are listed on the Module Objectives pages(s). In situations where the 
training is more highly focused, the trainer should formulate more 
specific objectives. 

Determine evaluation instruments and procedures. Evaluation procedures 
and questions co"respond ing to the object i"es are listed in the 
Evaluation Procedu es and Criteria section. Additional evaluation 
questions snouia De deveTopea in situations where additional or more 
specific objectives have been formulated. 

Determine learning activities. 

a. Review the Content Outline section and select the content to 
be presenter! 

b. Review the Learnino Activities section and prepare learning 
activities that relate to the objective:*. 

Note: It is recommended that the format of the training session 
include frequent participant activities in addition to a 
traditional lecture presentation. For maximum effec- 
tiveness the trainer should change the format of the 
session at least every 30 minutes. m most cases this 
will require the development of additional learning 
activities. 

Prepare overhead transparencies. 

a. Select and make overhead transparencies that will be used in the 
training session. 

b. Additional transparencies should be developed bv the trainer when 
specific Information needs to be emphasized. 
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TRAINERS 6UIDE 



4, 



c. In some cases the trainer may need to enlarge the transparencies 
when the training session wT.l be conducted In a large room. Some 
transparencies will need to be separated where two have been placed 
on a page. 



9. Prepare handouts 

a. Select and duplicate handouts. 

b. Additional handouts and materials for activities should be developed 
as needed. 

DELIVERY DF MODULE TRAINING 

The following Is a list of recommendations for trainers relating to the 
delivery of module Instruction. 
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I. 

2. 
3. 
4. 



5. 
6. 

7. 
8. 
9. 



Select a site conducive to training by considering the following: 

a. adequate size 

b. temperature control 

c. ventilation 

d. acoustics 

Provide comfortable, moveable chairs and a hard writing surface for 
each participant. 

Begin with a welcome and Introduction of yourself. Include Information 
on your background, training, and experience. 



Explain the purpose of training. 

rationale (see Inst 

section) . 



a. Provide a rationale (see Instructional Design Specifications 



b. Display and/or distribute a copy of the objectives the participants 
are expectad to meet. 

c. Provide participants with a content outline listing the major and 
secondary level topics to be presented. 

Explain the evaluation procedures to the participants. 

It Is recommended that the trainer provide a 10-m1nute break each hour. 
If the training session Is to span the normal lunch period, provide at 
least 90 minutes. Access to refreshments during the training period Is 
recommended. 

Inform participants of the time-frame you Intend to follow. 

Periodically summarize the Information you have presented. 

Encourage participants to ask questions, ask for clarification, and/or 
ask for additional examples. 



TRAINING EVALUATION 

At the conclusion of the training sesslon(s), ask the participants to 
complete the Training Evaluation Form. 
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NEEDf ASSESSMENT 



c/set Module IS; ASSESSMENT OF EXCEPTIONAL INDIVIDUALS 

Purpose ; This nodule has been deslgnea to neet the needs of individuals 

with & broad range of skills and experiences. Therefore, 
not all training sections and components may be appropriate 
for you. To determine your training needs and to make our 
training oore efficient and effective, please complete the 
following survey. Slnc^ we need this Information to prepare 
for the actual training sessions, please return the survey 
as soon as possible to: 



Rating 
High Med Low 



11. How to Assess Academic Skills 1 2 

12. What Social Behaviors to Assess 1 2 

13. How to Assess Social Skills 1 2 

14. Indirect Observation Strategies 1 2 

15. Direct Observation Strategies 1 Z 



What other concerns, needs, or questions do you have regarding the 
topic covered In this module? 



Instructions ; Please rate each jf the followin items with one of the following 
Indications; 

1. High training priority {'•must be covered") 

2. Heuiua training priority could use the information") 

3. Low priority ("Not needed or applicable**) 



opic 



Rating 
High Med Low 



. Direct Interventionest Approach 

Critical Components of th^ Instructional Setting 

Stages of Learning 
, Systematic Instruction 
. Assessme..v and Evaluation 

6. Kinds of Assessment 

7. Assessment (guidelines 

8. Technical Aspects of Assessment * 



^ Basic Strategies for Assessing Academic Performance i 
E^^Wh^t^cademlc Skills to Assess 1 



Other comments, concerns, recommendations. 
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6. 



C/SET Training Module 



AssessMent of Exceptional Individuals 



£Qif£EIEH£Ii 



Upon coapletion of this »^^ule» participants should be 
able to utilize basic asse^ssent and evaluation procedures 
when teaching the handicapped adolescent and young adult 
in correctional settings. 



BAIIQHALE' ^^^Y correctional institutions^ there is an over- 

representation of handicapped Juvenile and adult offenders. 
It is estiaated that up to SOX of the insate population is 
handicapped. Although correctional education progress are 
offered in the vast sajority of correctional facilities, 
these prograss often do not seet the needs of handicapped 
offenders. An isportant aspect of an appropriate education 
progras for handicapped students is the assesssent of stu- 
dent strengths and weaknesses. Assesssent is a critical 
aspect of curriculus planning and instruction. 



EBEBESUISIIES' it is recossended that participants be fasiliar with 

principles of instruction and curriculua vhich are covered 
in the Curriculus and Methods sodules. 
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OBJECTIVES: 



Upon co«pUtlon of thla ■odul». participant, should f mbim toi 

1. Dascrlba tha ch«ractarl»tlc« of m direct 
intarvantlonlat approach to Inatructlon. 

2. Daacrlba tha critical coaponanta of tha claaarooa 
aatting that •timet Inatructlon and iaarning. 

3. Daacrlba tha definition and ganaral Inatructlonal 
•aphaala of aach ataga of laarnlng. 

4. Daacrlba and IXXuatrata tha alght atapa In a 
■yataaatlc aodaX of Inatructlon. 

5. Daacrlba tha alallar^f.y and dlffaranca batwaan 
•aaaaaaaant" and "avaXuatlon. * 

6. Daacrlba tha purpoaa of collaotlng aaaaaaaant data. 

7. Daacrlba tha charactarlatlca for "auaaatlva' and 
■foraatlva* aaaaaaaant and evaluation. 

a. Daacrlba tha rola of "data-baaad daclaion aaklng" 
In tha ayataaatlc Inatructlon aocal. 

9. Daacrlba tha factora that charactarlza affactlva 
and efficient data-baaad daclaion aaklng. 

10. Daacrlba tha four lavala of aaaaaaaant. 

11. Explain raaaoaa for conducting aaaaaaaanta. 

12. Daacrlba tha quaatlona taachara ahould aak vhan 
thay ara daacrlolng tha aaaaaaaant altuatlon. 

13. Daii-riba what naada to ba dona to plan a taat axarclaa. 

14. Daacrlba quaatlona that ahould ba aakad vhan 
daacrlblng what atudant parforaanca will ba awaluatad. 

15. Daacrlba quaatlona to ba aakad whan daalgnlng a 
plan for rating and recording atudant parforaanca. 

16. Vhan evaluating the technical aapacta of aaaaaaaant 
procadurea and inatruaanta, deaorlba what prerequlaite 
Inforaation auat ba conaldered. 

17. Define and daacrlba the following aapacta that affect 
our confidence in an aaaeaaaar«t procedure: reliability, 
validity, standard deviation, nora. 
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18. Define the purpoae of ■dlagnoala. * 

19. Daacrlba the coaponenta of • two-tiered approach 
to dlagnoala. 

20. Daacrlba atrateglea for deteralnlng relative 
atanding or peer coaparlaona. 

21. Daacrlba the charactarlatlca and three coaponenta 
of doaain-raferencad teatlng. 

22. Daacrlba atrateglea and guldellnea for defining 
Itea aalaction procedurea. 

23. Daacrlba the charactarlatlca and differencea of 
aalaction and aupply type iteaa. 

24. Daacrlba the charactarlatlca, guldellnea, and 
conalderationa aaaociatad vith the adainiatration, 
acoring, and ^'eporting of teata and teat outcoaea. 

25. Explain why it la iaportant to aaaaaa aocial akiili 

26. Describe how to look at aocial bahaviora in an 
cibjective and poattive faahion. 

27. Explain tha differencea aaong behavioral 
exceaaea, deficita, and aaaeta. 

28. Describe vhat aocial akillc can be assessed. 

29. Describe vhai. ahould be asaessed vhan 
asseesing aocial .^^lilla. 

30. Describe the aix diaenaiona of m behavior. 

31. Describe indirect observation strategies 
for assessing social skills. 

32. Describe direct observation stiategiec for 
assessing social akilla. 

33. Daacrlba yhat functional relationships are 
and how they are identified. 

4. Deacribe tha difference between testable 
explanations and explanatory fictiona. 
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IQ me IB&IlfE^B; THE FOLLOWING ARE SAHPLES OF POSSIBLE TEST ITEHS THAT 
HAY BE USE!) TO ffZASURE LEARNER PARTICIPATION IN THE ASSESSMENT MODULE. THESE 
ITEHS EIHPHASIZE THE PARTICIPANT COMPETENCIES GIVEN IN THE TRAINER'S GUIDE. THE 
TRAINER SHOULD ADO AND DELETE ITEMS TO MEET THEIR INDIVIDUAL TEACHING SEQUENCES 
AND METHODS. 

I. THE DIRECT, INTERVENTIONIST APPROACH TO INSTRUCTION IS CHARACTERIZED 
AS ACTIVE, RESPONSIBLE, FUNCTIONAL, AND 

A. PERFORItAHCE- BASED 

B. PROCESS ORIENTED 

C. DYNAMIC 

D. NON-DIRECTED 

E. A & C 



2. VHICH OF THE FOLLOWING IS/ARE CRITICAL COMPONENTS THAT MUST BE CONSIDERED 
IN PLANNING ASSESSMENT AND INSTRUCTION FOR THE HANDICAPPED ADOLESCENT 
AND YOUNG ADULT IN CORRECTIONAL SETTINGS? 

i STUDENT CHARACTERISTICS 

B. TEACHER CHARACTERISTICS 

C. SOCIAL ENVIRONMENT 

*>. SCHOOL OR EDUCATIONAL PLACEMENT 
E. ALL OF THE ABOVE 



3. WHEN TEACHING A STUDENT WHO IS IN THE MAINTENANCE PHASE OF LEARHIHG, 
THE INSTRUCTIONAL MANIPULATIONS EMPHASIZE 

A. ANTECEDENT VARIABLES 

B. RESPONSE VARIABLES 

C. CONSEQUENCE VARIABLES 

D. A & B 

E. B A C 



4. LIST THE EIGHT STEPS IN A SYSTEIIATIC INSTRUCTION MODEL 

1. 2. 3. 4. 



S. 6. 7. 8. 



5. SUIfMATIVE ASSESSMENT PROCEDURES 

A. ARE THE SAME AS FORMATIVE ASSESSMENT PROCEDUHES 

B. EMPHASIZE THE MEASUREMENT OF THE END OUTCOME OF LEARNING AND 
INSTRUCTION 

C. EMPHASIZE THE CONTINUOUS MEASUREMENT OF STUDENT PERFORMANCE 

D. EXAMINE THE COLLECTION OF BACKGROUND INFORMATION ABOUT A STUDENT 

E. A A D 




6. 'IF MIKE SCORES AT 6SX OR LOWER FOR THREE CONSECUTIVE DAYS ON HIS 

VOCATIONAL EDUCATION ASSIGNMENTS, CHANGE INSTRUCTIONAL." THIS STATEMENT 
IS AN EXAMPLE OF A<N) 

A. FORMATIVE ASSESSMENT 

B. BEHAVIORAL OBJECTIVE 

C. DATA BASED DECISION RULE 

D. ERROR ANi LYSIS 

E. PHASE OF LEARNING 



7. FOR EACH OF THE FOUR LEVELS OF ASSESSMENT, GIVE AN EXAMPLE OF AN 
ASSESSMENT PROCEDURE 

A. LEVEL ONE 



B. LEVEL TWO 



C. LEVEL THREE 



D. LEVEL FOUR 



8. DATA BASED DECISION-MAKING PROCEDURES ARE USED TO ASSESS STUDENT 
PERFORMANCE 

A. FORMATIVELY 

b. SUMMATIVEuY 

C. CUKMULATIVELY 

D. EPISODICALLY 

E. INTERMITTENTLY 



9. CHECK EACH STATEMENT THAT IS TRUE WITH RESPECT TO DATm-BASED DECISION 
MAKING 

MEASUREABLE BEHAVIORS ARE REQUIRED 

accurracy levels are MEASUREABLE 

INDIRECT MEASUREMENT SYSTEMS ARE USED 

MEASUREMENT PROCEDURES ARE IMPLEMENTED IN A 

SUMMATIVE MANNER 

•IF... THEN... • STATEMEN'iS ARF, USED 
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10. ;<£SCRIBE VHAT QUESTIONS TEACHERS WOULD ASK THEMSELVES IN EACH STEP OF A 
Sinp;.<i ASSCSSRENT PROCESS 

STEP ONE: DESCRIBE THE ASSESSMENT SITUATION 

STEP TWO: PLAN A TEST EXERCISE 

STEP THREE: DESCRIBE THE PERFORHAHCE TO BE EVALUATED 

STEP FOUR: DESIGN A PLAN FOR RATING AND RECORDING PEFORHANCE 

11. "TESTS SHOULD BE BIAS-FREE." ANOTHER WAY OF STATING THIS IS 

A. ASSESS STUDENT FAMILIAL, FACIAL, AND SEXUAL HISTORIES. 

8. ASSESS THE STUDENT'S OWN ATTITUDE AND BIASES. 

C. ASSESS THE STUDENT *S ACTUAL PERFOUHANCE 

D. ASSESS THE MOTIVATION OR DRIVE BEHIND A STUDENT'S PERFORMANCL 

E. ALL OF THE ABOVE 



12. TRUE OR FALSE. "WHENEVER WE MEASURE SOMETHING, SOME DEGREE OF ERROR 

;S ALWAYS PRESENT. " 



13. TEACHERS CAN EVALUATE THE AMOUNT OF ERROR PRESENT IN THE MEASUREMENT OF A 
STUDENT'S PERFORMANCE BY USING THE FOLLOWING STATISTICS (CHECK ALL THAT 
APPLY) 

A. RELIABILITY COEFriCIENTS 

B. VALIDITY 

C. STANDARD DEVIATIONS 

D. NORMATIVE DATA 

E. MEAN SCORE 



14. MATCH THE TERM WITH THE PROPER DESCRIPTION 

RELIABILITY DIAGNOSIS VALIDITY 



REFERS TO THE DEGREE OF AGREEMENT IN REPEATED MEASURES OR 
ASSESSMENTS OF SOMETHING 

REFLECTS THE EXTENT OR DEGREE TO WHICH A MEASUREMENT PROCEDURE 
MEASURES WHAT IT IS INTENDED TO MEASURE. 

REFERS TO THE DEVELOPMENT OF AN ASSESSMENT SITUATION THAT IS 
DESIGNED TO ANALYZE A STUDENT'S CURRENT ACADEMIC SKILLS AND 
INTERFERING ERROR PATTERNS. 



IS. WHEN TEr.CHERS ENGAGE IN DIAGNOSIS AT THE "SURVEY" LEVEL FOR CONSTRUCTING 
ACADEMIC TEST MATERIALS, THEY SHOULD 
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A. TAKE RANDOM SAMPLES FROM A WIDE RANGE OF PROBLEMS 

B. PRESENT PROBLEMS IN A RANDOM MANNER 

C. GIVE STUDENTS INFORMATION ABOUT WHAT WILL BE INCLUDED IN A TEST 

D. ALL OF THE ABOVE 



TRUE OR FALSE A "TASK ANALYTIC" APPROACH TO DIAGNOSIS REQUIRES 
TEACHERS TO CLASSIFY THE TYPES OF STUDENT ERRORS 
THAT OCCUR AND TO DEVELOP MATERIALS FROM THtGE 
IDENTIFIED ERRORS 



WHEN TEACHERS USE A "PEER-COMPARISON" APPROACH TO ASSESSMENT, THEY 
COMPARIKG THE STUDENT'S PERFORMANCE TO 

A SOME CURRICULUM-BASED PERFORMANCE CRITERION 

B. A NORMATIVE BASE SO THAT AN IDEA OF RELATIVE STANDING CAN BE 
DETERMINED 

C. CALCULATE THE AMOUNT OF GROWTH THE STUDENT HAS MADE OVER TIME 

D. EVALUATE THE TECHNICAL ADEQUACY OF A TEST ITEM 

E. ALL OF THE ABOVE 



TRUE OR FALSE "STANDARDIZED" TESTS ARE CHARACTERIZED BY A WELL- 
DEFINED DOMAIN FROM WHICH ITEMS ARE SAMPLED AND A 
CRITERION FOR DRTERMINIMC MASTERY. 



LIST DIFFERENT STRATEGIES TEACHERS CAN USF TO MAJ IMIZf; STUDENT 
PERFORMANCE ON WRITTEN TESTS 



EXPLAIN WHAT INFORMATION IS PRESENT AND MISSING IN THE FOLLOWING 
PERFORMANCE SCORING FORMATS 

PERCENT SCORES 



RATE SCORES 



CUMULATIVE PERFORMANCE 



mBER OF PROBLEMS CORRECT 



TRUE OR FALSE SOCIAL SKILLS REQUIRE DIFFERENT ASSESSMENT 

PROCEDURES THAN THOSE USED WITH ACADEMIC PERFORMANCE. 

TRUE OR FALSE SOCIAL SKILLS DO NOT HAVE TO BE TAUGHT AS 
ACADEMIC BEHAVIORS DO 
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10. 



23. GIVE THREE EXAMPLES OF KXMDS OF BEHAVIOR FOR EACH OF THE FQLLOWIHG 
CATEGORIES 

BEHAVIORAL EXCESSES 



BEHAVIORAL DEFICITS 



27. IN ADDITION TO FREQUENCY OR RATE* BEHAVIORS CAN BE ASSESSED ACCORDING TO 



INTENSITY 
LOCUS OR PLACE 
DURATION 
LATENCY 

TOPOGRAPHY OR SHAPE 
ALL OF THE ABOVE 



BEHAVIORAL ASSETS 

24. DEFINE THE FOLLOWING BEHAVIORS INTO OPERATIONAL AND OBSERVABLE TERHS. 
AGGRESSION 
WITHDRAWAL 
HONESTY 
MANIPULATOR 
HYPERACTIVE 
LAZY 

25, ONE OF THE MOST IMPORTANT REQUIREMENTS WHEN ASSESSING PROBLEH SOCIAL 
BEHAVIORS IS TO IDENTIFY 

'HE PARENTS INFLUENCE ON THE BEHAVIOR 

•HE UNDERLYING OR INTERNAL FACTORS THAT CONTRIBUTE TO THE PROBLEM 
C. SUITABLE REPLACEMENT RESPONSE FOR THE PROBLEM 

26. DEFINE EACH OF THE FOLLOWING ASSESSMENT FACTORS 
SETTING FACTORS 

PRE-DISPOSING FACTORS 
PRECIPITATING OR TRIGGERING FACTORS 
CONTRIBUTING FACTORS 
TIME FACTORS 

BEHAVIOR DIMENSION FACTORS 



28. 



THERE ARE A NUMBER OF WAYS THAT SOCIAL SKILLS CAN BE ASSESSED WITHOUT 
DIRECTLY OBSERVING THE BEHAVIOR. NAME AT LEAST FOUR DIFFERENT METHODS. 



29. 



1. 
3. 



DESCRIBE THE CONDITIONS UNDER WHICH TEACHERS MIGHT CONSIDER USING INDIRECT 
METHODS OF ASSESSING SOCIAL BEHAVIORS. 



30. TRUE OR FALSE 



A FUNCTIONAL ANALYSIS IS A SIMPLE PROCEDURE 
PRIMARILY DESIGNED TO INDIRECTLY MEASURE THE 
FREQUENCY OR RATE WHEN A BEHAVIOR IS OBSERVED. 



31. FUNCTIONAL RELATIONSHIPS ALLOW TEACHERS TO DETERMINE 

A. CAUSE-EFFECT RELATIONSHIPS 

B. PREDICTABLE BEHAVIORAL CHAINS 

C. HYPOTHETICAL CONSTRUCTS 

D. MEANINGFUL ADULT-PARENT-CHILD RELATIONSHIPS 

E. ALL OF THE ABOVE 



32. CHECK WHICH OF THE FOLLOWING STATEMENTS ARE "TESTABLE EXPLANATIONS' 

WHENEVER THE TEACHER HAS A TRANSITION BETWEEN LESSONS THAT EXCEEDS 
FIV£ MINUTES* THE NUMBER OF TALKOUTS INCREASES THREEFOLD. 

IF ELLEN SITS NEXT TO SAH DURING MATH CLASS* JIM DOES NOT FINISH HIS 
WORK AND WILL TALK WITH ELLEN. 
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lJIiING ACTIVITIES: 



ASSESSMENT OF EXCEPTIONAL INDIVIDUAL^ 11. 



THE FOLLOWING ACTIVITIES HAVE BEEN DESIGNED TO ACCOMPANY THE PRESENTATION 
OF MODULE CONTENT. AN ATTEMPT HAS BEEN HADE TO PREPARE AT LEAST ONE ACTIVITY 
PER PARTICIPANT COMPETENCY. TRAINERS SHOULD NOT ATTEMPT TO PRESENT ALL 
ACTIVITIES, BUT INSTEAD SHOULD SELECT THOSE THAT BEST FACILITATE THE ACQUISI- 
TION AND PRACTICE OF DESIRED PARTICIPANT DUTCOHES. EACH ACTIVJTIY HAS BEEN 
KEYED TO THE OUTLINE NUMBERING SYSTEM USED THROUGHOUT THE MODULE CONTENT 
OUTLINE. 

SINCE SOME OF THE ACTIVITIES MAY REQUIRE THE PREPARATION OF MATERIALS 
AND/OR MAY REQUIRE DIFFERENT AMOUNTS OF TIME FOR COMPLETION, TRAINERS SHOULD BE 
THOROUGHLY FAMILIAR WITH TRAINER AND TRAINEE RFOUIREMENTS. 

2..Q IHIBQfigCIIM 

2.3 YOU HAVE BEEN ASKED TO PRESENT A TRAINING SESSICM THAT INCLUDES A 
DESCRIPTION OF THE 'DIRECT INTERVENTIONIST APPROACH" TO ASSESSMENT 
AND INSTRUCTIONAL PROGRAMMING. DESCRIBE A PRACTICAL EXAMPLE THAT 
ILLUSTRATES EACH OF THE CHARACTERISTICS OF THIS APPROACH. 

a..Q «IIICAL CQgCMEMIS K IHS IISIIUCIIOIAl SCniK 

3.2 THE ADOLESCENT AND YOUNG ADULT LEARNER BRING MANY FACTORS TO THE 

LEARNING ENVIRONMENT THAT MUST BE CONSIDERED WHEN ASSESSING LEARNER 
PERFORMANCE. DESCRIBE HOW EACH OF THESE FACTORS HAVE AFFECTED YOUR 
ASSESSMENT PRACTICES. 



9. 1 A STUDENT IS BEING REFERKFH INTO YOUR CLASSROOM. DESCRIBE THE 

TYPES OF INFORMATION YOU WOULD LIKE TO KNOW ABOUT THE SYSTEM 
FROM EACH OF THE FOUR LEVELS OF ASSESSMENT. 

10.1 YOU ARE ASSESSING A STUDENT'S ACADEMIC PERFORMANCE, AND A PARENT 
ASKS YOU WHY YOU ARE DOING ASSESSMENTS. WHAT KIND OF GENERAL 
EXPLANATIONS WOULD YOU PROVIDE THE PARENT? 

10.2 AS YOU APPROACH AN ASSESSMENT IN MS. TIRES' CL/SSROOI. WHAT 
QUESTIONS SHOULD YOU BE PREPARED TO ASK HER CONCERNING THE 
CLASSROOM SITUATIOHT 

10.3 AFTER YOU'VE ASSESSED MS. TIRES' CLASSROOM SITUATION. WHAT 
FACTORS NEED TO BE CONSIDERED WHEN PLANNING THE TEST EXERCISE? 

10.4 FROM THE TEST EXERCISE PLANNING, STUDENT PERFORMANCE MUST BE 
EVALUATED. WHAT QUESTIONS WOULD YOU ASK YOURSELF IN DESCRIBING 
THE PERFORMANCE TO BE EVALUATED? 

10. S ns. TIRES HAS COLLECTED A LARGE AMOUNT OF DATA ON LEARNED 

PERFORMANCE, BUT NOW SHE NEEDS TO RATE AND RECORD THESE DATA. 
WHAT ADVICE AND GUIDELINES WOULD YOU PROVIDE HER? 



3.3 IDENTIFY SOME OF THE CHARACTERISTICS YOU, AS A TEACHER BRING TO THE 
CLASSROOM ENVIRONMENT AND EXPLAIN HOW IT AFFECTS YOUR ASSESSMENT 
PRACTICES. 

3.4 DESCRIBE AND ILLUSTRATE THE MAJOR SOCIAL ENVIRONMENTAL INFLUENCES OF 
THE ADOLESCENT AND YOUNG ADULT THAT AFFECT YOUR ASSESSMENT EFFECTIVE- 
NESS AND DECISION MAKING. 

I1.Q SIAfiES QC IrfiABMIiiS 

4.2 IDENTIFY A STUDENT WITH WHOM YOU HAVE WORKED AND DESCRIBE HIS/HER 
PERFORMANCE DURING EACH OF THE FIVE PHASES OF LEARNING. INCLUDE 
THE ASSESSMENT EMPHASIS THAT SHOULD BE TAKEN AT EACH OF THE PHASES. 

3..Q SISIEBAIIC mSISUCIIQil 

5.1 IDENTIFY A SPECIFIC SKILL THAT NEEDS TO BE TAUGHT TO A STUDENT WITH 
WHOM YOU ARE FAMILIAR; DESCRIBE THE ASSESSMENT STRATEGIES YOU WOULD 
INCLUDE IN EACH OF EIGHT STEPS IN THE SYSTEMATIC INSTRUCTIONAL MODEL. 

fii.Q ASSCSSflEMI m EXAIUAIIQH 



IIlQ lECtiMICAL ASCECIS QC ASSSSSIIEHI 

11.1 HR. NELSON HAS REQUESTED EXAMINATION COPIES OF A NUMBER OF 
ACADEMIC SKILL ASSESSMENT INSTRUMENTS. WHAT PRE-REQUISITES 
SHOULD HE CONSIDER BEFORE PURCHASING AND ADMINISTERING ONE OF 
THESE INSTRUMENTST 

11.2 HR. NELSON REPORTS THAT HE WANTS TO DETERMINE THE CONFIDENCE 
LEVEL OF EACH INSTRUMENT, BUT HE IS CONFUSED ABOUT THE 
DIFFERENCES BETWEEN RELIABILITY, VALIDITY, STANDARD DEVIATIONS, 
AND NORM. EXPLAIN THESE TO MR. NELSON. 

14.2.1 THE SCHOOL DIAGNOSTICIAN SAYS HIS BASIC RESPONSIBILITY IS THE 
'DIAGNOSIS OF INDIVIDUAL STUDENT STRENGTHS AND WEAKNESSES.* 
WHAT DOES HE MEAN WHEN HE SAYS 'DIAGNOSIS?' 

14.2.2 WHEN CONDUCTING AN ACADEMIC DIAGNOSIS, HE USb:S A TWO-TIFRED 
APPROACH: SURVEY AND ANALYSIS. DESCRIBE HOW THEY ARE 
DIFFERENT. 



8.2.3 GIVE AN EXAMPLE HOW YOU USE SU.-rfATIVE AND FORMATIVE ASSESSMENT 
AND EVALUATION PROCEDURES IN YOUR CLASSROOMS. 

a. 2. 3 EXPLAIN HOW A DATA-BASED, DECISION-MAKING SYSTEM MIGHT APfLIED 
IN DEVELOPING AN ASSESSMENT STRATEGY TO MONITOR A STUDENT'S 
PREPARATION OF A WEEKLY MEAL PLAN. 



O KINDS Qt ASSESSBEn 
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14.3.1 nS. FERNANubZ HAS DEVELOPED A TEACHER-rfADE TEST DESIGNED TO 
ASSESS STUDENT READING COMPREHENSION. WHAT GUIDELINES SHOULD 
SHE FOLLOW WHEN ADMINISTERING THE TEST TO A GROUP OF STUDENTS 
TO DETERMINE THEIR RELATIVE PERFORMANCE STANDINGS? 

HA BQDAIil BECEBEBCEC lESIIBfi 
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14.4.1 



HS. FERIIAHDE2 WAMTS TO DEVELOP A DOHAIM SE«REHCEO TEST TO 
EVALUATE HER STUDEMT'S BASIC COMSUHER HATH SKILLS. «HAT THREE 
COHPONCNTS SHOULD SH£ BE SURE TO COVERT 



oji mi n 48SSS? 

15.2 HS. FERIIAIIDE2 WARTS TO VARY THE ^VPCS OF ITEHS JE IHC^^^^ 

HCB TEST SUE WARTS TO USE HULTIPLE CHOirS, TRUt- ALSE, HATCH- 
iS S'cJsSIFICA?iOR TVE ITERS. WHAT OUIOELIRES CAR YOU GIVE 
is FERRARDE2 TO HELP HER DECIDE WHICH TYPE OF ITEHS TO USE? 

15 3 HS FERRAMS>E2 RAS FORGOTTEII ABOUT SUPPLY TYPE ITEHS. WHAT ABE 

IHE DIFFERE^ES BETWECR SELECTIOR ARD SUPPLY TYPE ITEHS7 HE' P 
H» BY GIVIR3 SOIIE EXAHPLES OF THE DIFFEREHT SUPPLY TYPE ITEHS. 
USE BASIC CORSbUER RATR TYPE EXAHPLES. 



iiuQ m IQ 4»ES8 ACABSBIC CBEOJUIIS 

16.2 



16.3 



16.4 



MR RUTHBRrORD 18 A lOUT TO ADRIRISTER A SPELLING TEST THAT 
FOCUSES OR CORIWR WJRDS REQUIRED OH JOB APPLICATIONS.. WHAT 
Sr^ItStiTcORSIDERATIORS SHOULD HE KEEP IN HIND TO IHPROVE 
THE ACCURACY ARD UTILITY OF THE RESULTS? 

HR RUTHERFORD IS A GREAT PLARRER. HE KROWS THAT THE PROCESS OF 
SCORIRG A TEST BEOIRS BEFORE THE TEST IS ADHH ISTERED. WrfAT 
SiRDsVtHIROS DOES HS CQHSIDER WHEH PLARh; i FOR THE SCORXHG 
OF A STUDERT'S PERFORHARCE OR A TESTt 

MB RUTHERFORD CAR'T DECIDE IF HE SHOULD REPORT H^S TEST RESULTS 
USIMG PERCENT OR RATE. WHAT KIND OF IRFORHATIOR CAR YOU GIVE 

SfS ?o 5e[?hake Se decision betweer percent and rating sconxNG. 



18.3.3 HR. NELSON THINKS THAT ASSESSHERT OF SOCIAL BEHAVIORS IS LIHITED 
TO THE FREQUENCY WITH WHICH THE BEHAVIORS OCCUR. WHAT ARE THE 
FIVE OTHER BEHAVIORAL DIHENSIONS THAT COULD BE HEASURED WHEN 
ASSESSING BEHAVIORS? 



201.9 IHCUKI QI8UX4IIQI SIIAIEQIES 



20 1 HS. TINDAL FREOUERTLY FINDS THAT INDIRECT SOURCES OF IRFORHATIOR 

CAN BE VERY INFORHATIVE. DESCRIBE THE HAJOR SOURCES FROH WHICH 
IRFORHATIOR CAR BE OBTAINED ABOUT A STUDENT'S SOCIAL SKILLS. 



UuQ mm 468ESSfiEn SII4IE8ISS K SOCIAL HILLS 



21.2 



21.2 



21.2 



21.2.3 



WHEN HS. TINDAL GOES INTO A RELATIVELY NEW SETTING OR IS 
OBSERVING A REV STUDERT. SHE WILL FREOUERTLY CONDUCT A 
FUNCTIONAL ANALYSIS. SET UP A FUNCTIONAL ANALYSIS RECORDING 
SHEET. BE SURE TO IRCLUDE THE RECESSARY COHPONENTS. 

TAKE HS. TINDAL'S FURCTIORAL ANALYSIS FORH TO A CLASSROOH 
SETTING WITH THREE OR HORE STUDENTS. PICK ONE STUDENT AND DO 
A FUNCTIONAL ANALYSIS ON HIS/HER BEHAVIORS. 



DEVELOP POSSIBLE TESTABLE EXPLANATIONS. 
BE TESTED. 



EXPLAIN HOW THEY HIGHT 



HS. TINDAL FINDS THAT ROB TALKS BACK TO ADULTS BECAUSE HE IS A 
JUVENILE DELINQUENT. IS THIS STATEHENT A TESTABLE EXPLANATION 
OR AN EXPLANATORY FICTION? EXPLAIN YOUR ANSWER. 



iZ,.Q A8SESSUQ SOCIAL HHAIIQIS 

17 4 r^S WOLFORD VIEWS HERSELF AL AR EXPERT IN ACADEHIC PROG.-iAHHlRG 

ARD THIHKS THAT MCIAL SKILL TRAINING SHOULD BE THE RESPONSIBIL- 
n! OF lil ShIlToR COHHURITY. EXPLAIR WHY HS. WOLFORD SHOULD 
BE ASSE5SIRG SOCIAL SKILLS. 

UlQ mi SOCIAL SIILL8 10 ASSKS 

IB 2 WHEREVER BR. RELSOR ATTEHPTS TO ASSESS A STUDENT'S SOCIAL SKILLS 

STtS DISTRACTED BY HIS EHOTIONS AND FEELINGS ABOUT THE STUD- 
ENT. SUGGEST SOHE WAYS THAT HR. RELSON COULD LOOK AT SOCIAL 
BEHAVIORS IN AN OBJECTIVE AND POSITIVE HANNER. 

18 2 2 TO HELP HR. RELSON OUT. HOW WOULD YOU DISTINGUISH BETWEEN 

BEHAVIORAL EXCESSES, DEFICITY. ARD ASSETS? 

lA 3 HR RELSON IS OVERWS«ELHED BY THE VAST NUHBER OF BEHAVIORS THAT 

COULD BE ASSESSED. RATHER THAR TRYIRG TO EXPLAIR ALL THE 
SbEe bISa?Io2s, DESCRIBE THE SIZE COHPONENTS THAT HE COULD 
ASSESS. 
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1.0 THl DIRECT liTOVEIITICMiXST AFriMUCH 

1 1 A OIRFCT IMTEBVEJITIOIIIST APPROACH TO EDUCATIMO HAMDICAPPEO 

ADOLESCENTS AND YOUNG ADULTS IN CORRECTIONAL SETTINGS WILL BE 
MAINTAINED THROUGHOUT THIS NODULE ON ASSESSMENT AND EVALUATION. 

THIS PERSPECTIVE IS CHARACTERIZED AS (REFER TO METHODS MODULE 
FOR MORE INFORMATION) (DISPLAY I'l.lU 



i.XA ACTIVE IN THAT TEACHING AND CURRICULUM DECISIONS ARE 
ACTIVELY DIRECTED BY THE TEACHER, 

1.1.2 RESPOMSIBLE IN THAT THE TEACHER ASSURES THE 
RESPONSIBILITY FOR BOTH SUCCESSFUL AND UNSUCCESSFUL 
STUDENT LEARNING AND CURRICULUM OUTCOMES. 

1.1.3 FUNCTIONAL IN THAT THE CURRICULUM AND CONTENT OF INSTRUCTION 

(•) CAN BE DIRECTLY AND IMMEDIATELY APPLIED 2" THE 
STUDEMT'S ACADEMIC. SOCIAL. AND VOCATIONA 
ENVIRONMENTS. AND 

(b) INCREASE THE LIKELIHOOD OF SUCCESSFUL FUNCTIONING 
IN FUTURE SETTINGS. 

1 1 4 PERFORMANCE BASED IN THAT CURRICULUM EFFECTIVENESS IS 
DETERMINED BY EVALUATING ORSERVABLE AND MEASURABLE 
STUDENT PERFORMANCE. 

1 1.5 DYNAMIC IN THAT INSTRUCTIONAL AND CURRICULAR ADJUSTMENTS 

ARE MADE CONTINUCJSLY AND ARE BASED ON STUDENT PERFORMANCE. 



2.0 CRITICAL COHPONEITS OF THE INSTRUCTIONAL SETTING 



2.1 NHEN MEASURING STUDENT SKILL LEVELS OR PERFORMANCE ABILITIES 
(EITHER ACADEMIC OR SOCIAL BEHAVIORS). IT IS CRITICAL TO 
CONSIDER THE SETTING CONTEXT IN WHICH THE BEHAVIOR IS OCCURRING. 

2.1.1 STUDENTS DO NOT LEARN OR PERFORM IN A VACUUM... LEARNIMO 
IS USUAUY DIRECT AND INTENTIONAL. TEACHERS PRESENT THE 
CURRICULUM. MANIPUUTE THE INSTRUCTION. AND GIVE 
REWARDING OR CORRECTIVE FEEDBACK IN A MANNER THAT IS 
SYSTEMATIC AND DIRECT. 

(«) THESE TEACHER VARIABLES MUST BE ASSESSED WHEN 
EVALUATING STUDENT LEARNING. 

2.1.2 SIMILARLY. LEARNING CAN BE UNINTENTIONAL AS NELL AS 
INTENTIONAL. THE TEACHER CAN ONLY CONTROL AND 
MAMIPUUTE A LIMITED NUMBER OF INSTRUCTIONAL VARIABLES. 
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(a) THESE VARIABLES RESIDE OUTSIDE THE INSTRUCTIONAL 
PROCEDURES AND CURRICULUM... AND MAY OR MAY NOT BE 
INFLUENTIAL TO STUDENT LEARNING OR PERFORMANCE. 

(b) THESE VARIABLES ARE ASSOCIATED WITH AND/OR 
CONTROLLED BY 

- THE STUDENT 

- THE TEACHER 

• THE SOCIAL ENVIRONMENT NHICH INCLUDES 

- PARENTS/FAMILY OF THE STUDENT 

- PE^R GROUP 

- SCHOOL ENVIRONMENT 

2.1.3 WE'LL TALK ABOUT EACH OF THESE BRIEFLY. A MORE DETAILED 
AND DESCRIPTIVE DISCUSSION CAN BE FOi^ND IN THE METHODS 
MODULE (DISPLAY T-2. 1.3). 

2.2 THE STUDENT BRINGS FACTORS TO THE LEARNING ENVIRONMENT WHICH 
MUST BE CONSIDERED IN PLANNING INSTRUCTION. 

2.2.1 THE STUDENT'S HANDICAPPING CONDITION OR BEHAVIOR*^ 
(■) MOTOR/PHYSICAL LIMITATIONS 

(b) SENSORY IMPAIRMENTS (VISUAL. AUDITORY. KINESTHE IC. ETC.) 

(c) BEHAVIORAL INTERFERENCES 

- BEHAVIORAL EXCESSES. SUCH AS AGGRESSION AND 
HYPERACTIVITY 

- BEHAVIORAL DEFICITS. SUCH AS LOW RATES OF VERBAL 
INTERACTIONS OR OTHER UNLFARNED SKILLS 

id) LEARNING DEFICITS WHICH GENERALLY INCLUDE UNLEARNED 
ACADEMIC PREREQUISITE SKILLS. 

2.2.2 THE STUDENT'S BIOLOGY OR INHERITED CHARACTERISTICS 

(■) PHYSICAL ANOMALIES 

(b) METABOLIC ANOMALIES 

(c) SENSORY ANOMALIES 

2.2.3 THE STUDENT'S PARENTAL/FAMILY DYNAMICS 

(a) RACIAL. CULTURAL. RELIGIOUS CHARACTERISTICS 

(b) 'nCATlONAL/FINAK^IAL/ECONOMIC STATUS 

(c) PARENTING STYLE. wHTH AFFECT AND BEHAVIOR 
MANAGEMENT STYLE. 

E.G.. AUTHORITARIAN « DICTATORIAL. 

UNDEMOCRATIC. UNCOMPROMISIhG. 

AUTHORITARIAN • DEMOCRATIC. 
COMPROMISING. 
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PEMISSIVE • MOMOIRECTIVE. PERMISSIVE 
UNQUESTIONING. 

2.2. A THE STUDENT'S LEARNING HISTORY 

(a) ACADEMIC HISTORY 

(b) SOCIAL SKILL HISTORY 

2.2.5 THE STUDENT'S EDUCATIONAL PLACEMENT HISTORY 

(a) REGULAR EDUCATION 

(b) SPECIAL EDUCATION 

(c) CORRECTIONS 

NOT ONLY MUST TEACHERS ASSESS AND CONSIDER THE STUDENT'S 
CHARACTERISTICS AND LEARNING PERFORMANCES, THEY MUST ALSO 
ASSESS AND EVALUATE THEIR OWN INFLUENCING OR BIASING 
CHARACTERISTICS. 

2.3.1 THE TEACHER'S BIOLOGY OR INHERITED CHARACTERISTICS 

(a) PHYSICAL ANOHALIES 

(b) METABOLIC ANOHALIES 

(c) SENSORY ANOMALIES 

2.3.2 THE TEACHER'S BACKGROUND HISTORY 

(a) RACIAL. CULTURAL, RELIGIOUS CHARACTERISTICS 

(b) VOCATIONAL/FK:ANCIAL/ECONOHIC STATUS 

(c) FAMILIAL HISTORY, BOTH AFFECTIVE AND MANAGEMENT 

STYLE. I.E., AUfHORlTARIAN, AUTHORITATIVE, 
PERMISSIVE 

2.3.3 THE TEACHER'S LEARNING HISTORY 

(a) ACADEMIC HISTORY 

(b) SOCIAL SKILL HISTORY 

2.3.4 THE TEACHER'S EDUCATIONAL HISTORY 

(a) TEACHER TRAINING EXPERIENCES 

(b) PREVIOUS EMPLOYMENT HISTORY 

(c) CURRENT EMPLOYMENT PERSPECTIVES, REQUIREMENTS, 
LIMITATIONS, ETC. 

- INCLUDING FINANCIAL SUPPORT, EDUCATIONAL PHILOSOPHY, 
ADMINISTRATIVE SUPPORT, MATERIAL AND SERVICE RESOURCES, 
ETC. 

THE SOCIAL ENVIRONMENT OF THE ADOLESCENT HAS A SIGNIFICANT INFLUENCE 
OH INSTRUCTIONAL PROGRAMMING AND TEACHING EFFECTIVENESS, ESPECIALLY WITH 
RESPECT TO ACADEMIC AND SOCIAL BEHAVIOR MANAGEMENT... THUS, IT ALSO MUST 
BE CAREFUUY TAKEN INTO CONSIDERATION DURING THE ASSESSMENT OF ACADEMIC 
AND SOCIAL BEHAVIORS. 
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2. 4. 1 AS MENTIONED ABOVE, THE PARENTS/FAMILY OF THE ADOLESCENT 
SHAPE THE STUDENT'S VALUES, ATTITUDES, OVERT BEHAVIORS, ETC. 

2.4.2 PEERS AND THE ROLE OF THE ADOLESCENT IN THE PEER GROUP 
MUST BE CONSIDERED DURING ASSESSMENT PROCEDURES. 

(a) THE ROLE OF THE PEER GROUP BECOMES MORE IMPORTANT 
IN SHAPING SOCIAL BEHAVIORS DURING ADOLESCENCE THAN 
DURING EARLY CHILDHOOD EXPERIENCES. 

(b) THE ADOLESCENT HUST DEAL WITH RULES AND GUIDELINES 
ASSOCIATED WITH POPULARITY, LEADERSHIP, AND FOLLOWERSHIP. 
EACH ADOLESCENT IH EACH PEER GROUP DISPLAYS BEHAVIORS WHICH 
ESTABLISH A VARIETY OF ROLES, I.E., LEADER, FOLLOWER, 
INSTIGATOR, SCAPEGOAT, FALLGUY, ETC. 

2.4.3 THE SCHOOL OR EDUCATIONAL PLACEMENT ALSO AFFECTS THE 
SOCIAL AND ACADEMIC DEVELOPMENT OF THE ADOLESCENT 
(KAUFFMAN, 196S). 

(a) INSENSITIVIY TO STUDENT'S INDIVIDUALITY 

> FAILURE TO ACCOMMODATE INDIVIDUAL LEARNING AND 
BEHAVIORAL DIFFERENCES 

(b) INAPPROPRIATE EXPECTATIONS 

- TEACHER EXPECTANCIES AFFECT HOW TEACHERS BEHAVE 
TOWARD INDIVIDUAL STUDENTS 

(c^ INCONSISTENT MANAGEMENT 

- CONDITION UNDER WHICH TEACHER BEHAVIOR CANNOT BE 
PREDICTED BY STUDENTS 

(d) INSTRUCTION IN NONFUNCTIONAL AND IRRELEVANT SKiLLS 

- STUDENTS MUST ASSESS AND BE CONVINCED THAT A 
PARTICULAR LEARNING ACTIVITY IS IMPORTANT AND 
THAT IT IS IMPORTANT IN THE FUTURE. 

- TEACHERS MUST ASSESS FOR AND SELECT 
INSTRUCTIONAL SKILLS THAT ARE FMSCTIONAL AND 
PRODUCE CRITICAL EFFECTS, I.E., THOSE BEHAVIORS 
WHICH WILL BE ASSOCIATED WITH REWARDING OUTCOMES. 

(•) NEFARIOUS CONTINGENCIES OF REINFORCEMENT 

- E.G., THE STUDENT RECEIVES ATTENTION WHICH 
STRENGTHENS AND MAINTAINS INAPPROPRIATE BEHAVIORS. 

- THERE IS ALSO A FAILURE TO PROVIDE REGULAR 
ATTENTION AND FEEDBACK FOR APPROPRIATE BEHAVIORS. 

(I) UNDESIRABLE MODELS 
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- BOTH DESIRABLE AND UNDESIRABLE BEHAVIORS HAY 
BE MODELED BY TEACHERS AND PEERS. 

2.4.5 THE SOCIAL DEVELOPMENT OF THE ADOLESCENT IS AFFECTED BY 
WHAT IS PRESENTED AND EMPHASIZED IN THE MASS MEDIA. 
KNOWING WHAT COMPONENTS OF THE MEDIA INFLUENCES LEARNING 
AND BEHAVIOR CAN BE A POWERFUL PIECE OF EVALUATION KNOWLEDGE. 

(•) TELEVISION 

- TV AGGRESSION IS AFFECTED BY THE STUDENT'S 
ABILITY TO DISCRIMINATE BETWEEN WHAT IS FANTASY 
AND REALITY. THE MORE REALITY-BASED THE STUDENT'S 
ABILITY TO INTERPRET WHAT IS VIEWED. THE LESS LIKELY 
THE AGGRESSIVE BEHAVIOR WILL BE MODELED OR LEARNED. 

- MUSIC TRENDS 

- CLOThlHG AND DRESS HABITS 

- MOVIES 



3.0 STAGES OF tCARNINO 



3.1 THE ASSESSMENT AND EVALUATION OF THE ACADEMIC AND SOCIAL 

BEHAVIOR OF THE HANDICAPPED ADOLESCENT OR YOUNG ADULT SHOULD 
BE CONDUCTED WITHIN THE CCWTEXT OF THE KIND OF LEARNING THE 
STUDENT IS ENGAGED IN. 

3. 1. 1 BY ASSESSING AT WHAT STAGE OF LEARNING A STUDENT IS 
FUNCTIONING. SPECIFIC REMEDIAL INTERVENTIONS AND 
STRATEGIES MAY BE IMPLEMENTED. 

- FOR EXAMPLE. INSTRUCTIONAL PROGRAMMING WOULD B.: DIFFERENT FOR 
A SKILL THAT IS BEING TAUGHT AND LEARNED FOR THE FIRST TIME 
(ACQUISITION) THAN FOR A SKILL THAT HAS BEEN MASTERED BUT 
NEEDS TO BE PRACTICED FOR IMPROVED FLUENCY OR PROFICIENCY. 

- E.G.. THE STUDENT WHO FAILS TO CALCULATE THE CORRECT ANSWER 
FOR A LONG DIVISION PROBLEM BECAUSE S/HE IS LEARNING THE 
COMPUTATION SEQUENCE FOR THE FIRST TIME WOULD RECEIVE DIFFERENT 
INSTRUCTION THAN THE STUDENT WHO HAS MASTERED THE SKILL BUT 
FAILS TO SHOW CCWSISTENT PERFORMANCE OVER TIME. 

- IN THE FORMER CASE, A SERIES OF COMPUTATIONAL RULES WOULD BE 
TAUGHT. I.E.. ANTECEDENT INSTRUCTIONAL MANIPULATIONS WOULD BE 
CONDUCTED. 

- IN THE LAHER CASE. THE RULES HAVE BEEN LEARNED? SO THE 
INSTRUCTIONAL EMPHASIS WOULD BE PLACED ON 'MOTIVATING' THE 
STUDENT TO SHOW MORE CONSISTENT PERFORMANCE. I.E.. CONSEQUENCE 
MANIPULATIONS. 
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THE DIFFERENT KINDS OF LEARNING STAGES MAY BE CHARACTERIZED IN 
ONE OF FIVE DIFFERENT WAYS. EACH OF THESE MIGHT REQUIRE A 
DIFFERENT INSTRUCTIONAL EMPHASIS (DISPLAY T-3.2). 

3.2.1 ACQUISITION PHASE OF LEARNING 

(a) DEFINITION - CONDITION IN WHICH A STUDENT HAS NEVER 
DISPLAYED THE SKILL OR HAS SHOWN IT AT EXTREMELY 
LOW CORRECT RATES. 

- FOR EXAMPLE. A STUDENT WhD HAVE NEVER OWNED A 
CHECKING OR SAVIHGS ACCOUNT PROBABLY WOULD NOT 
BE ABLE TO BALANCE HIS/HER ACCOUNT WITHOUT 
SPECIFIC INSTRUCTIONAL ASSISTANCE. 

(b' GENERAL INSTRUCTIONAL EMPHASIS 

- FOCUS ON STRATEGIES WHICH EMPHASIZE THE PRESENTATION 
OF INSTRUCTION AND THE SHAPING OF CORRECT RESPONSES. 

- FOCUS ON REGULAR AND MEANINGFUL FEEDBACK FOR 
CORRECT RESPONDING AND ON CORRECTIVE FEEDBACK 
FOR STUDENT ERRORS. 

3.2.2 FLUENCY OR PROFICIENCY PHASE OF LEARNING 

(■) DErlNITION - CONDITION IN WHICH THE STUDENT HAS 
DEMONSTRATED ACCURATE RESPONSES BUT INADEQUATE 
RATES OR FREQUENCIES OF RESPONDING. I.E.. TOO FAST 
OR TOO SLOW. 

- FOR EXAMPLE. A STUDENT MAY BE ABLE TO FILL OUT A 
JOB APPLICATION FORM ACCURATELY. BUT IT TAKES 
HIM/HER THREE TIMES AS LONG AS HIS/HER PEERS TO 
COMPLETE ONE APPLICATION. 

(b) GENERAL INSTRUCTIONAL EMPHASIS 

- FOCUS ON THE KIND OF FEEDBACK GIVEN FOR CORRECT 
RESPONDING. THE GOAL IS TO INCREASE THE STUDENT'S 
■MOTIVATION* BY GIVING HIM/HER IMMEDIATE AND POSITIVE 
FEEDBACK FOR CORRECT RESPONSES AND RATES. AFTER THE 
DESIRED PROFICIENCIES HAVE BEEN DEMONSTRATED. THE 
TEACHER WOULD GRADUALLY DECREASE THE AMOUNT AND FREQUENCY 
OF FEEDBACK. 

3.2.3 MAINTENANCE PHASE OF LEARNING 

(a) DEFINITION - CONDITION IN WHICH THE STUDENT HAS 
DEKONSTr^ATED ACCURATE AND FLUENT RESPONDING AND 
THIS LEVEL OF RESPONDING ENDURES OVER TIME. 

• FOR EXAMPLE. A STUDENT MAY BE ABLE TO DEMONSTRATE ACCURATE 
AND PROFICIENT TYPING SKILLS^ BUT AFTER A PERIOD OF TIME. 
S/HE IS UNABLE TO DEMONSTRATE THE SAME LEVELS OF TYPING. 
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(b) GENERAL INSTRUCTION EHPHASIS 

* FOCUS ON HAKIHG INSTRUCTIONAL FEEOBACK/REINFORCEHENT EVEN 
l<ORE INTCRHITTEHT. ALSO INCREASE THE DELAY BETWEEN THE 
STUDENT'S RESPONSE AND THE TEACHER'S FtEDBACK. AGAIN, THE 
ATTENTION IS FOCUSED ON INCREASING THE STUDENT'S "HOTIVA- 
TION* TO MAINTAIN ACCEPTABLE PERFORMANCE OVER TIHE. 

3.2.4 GENERALIZATION PHASE OF LEARNING 

(•) DEFINITION - CONDITION IN WHICH THE STUDENT HAS 
ACQUIRED A PROFICIENT AND ENDURING INSTRUCTIONAL 
RESPONSE WHICH IS ALSO OBSERVED UNDER DIFFERENT 
INSTRUCTIONAL OR TRAINING CONDITIONS. 

- FOR EXAMPLE, A STUDENT HAY BE COMPETENT AT 
USING A TIME CLOCK CORRECTLY AND PROFICIENTLY 

IN THE CLASSROOM SITUATION, BUT DOES NOT DISPLAY 
THE SKIU AT HIS/HER JOB AFTER SCHOOL. 

(b) GENERAL INSTRUCTIONAL EMPHASIS 

- FOCUS ON TEACHING THE INSTRUCTIONAL BEHAVIOR OR 
SKILL UNDER VARIED TRAINING CONDITIONS, I.E., VARY 
INSTRUCTIONAL MATERIALS, TRAINERS, SETTINGS, ETC. 

3. 2.5 ADAPTATION PHASE OF LEARNING 

(•) DEFINITION - CONDITION IN WHICH THE STUDENT 

MODIFIES A LEARNED CEHAVIOR TO PRODUCE SUCCESSFUL 
OUTCOMES UNDER VARIED INSTRUCTIONAL OR RESPONSE 
CONDITIONS. IT IS ALSO DESCRIBED AS THE APPLICA- 
TION OF PROBLEM SOLVING SEQUENCES TO NOVEL STIMULUS 
CONDITIONS. IT INVOLVES ADAPTING A SKILL TO MEET 
THE REQUIREMENTS Of A NEW SITUATION. 

- FOR EXAMPLE, A STUDENT MAY BE COMPETENT AT USING 
A COIN-OPERATED WASHING MACHINE, BUT IS UNABLE 

TO RUN A SIMILAR MACHINE THAT IS NOT COIN-OPERATED. 

(b) GENERAL INSTRUCTIONAL STRA'^EGY 

' FOCUS ON TEACHING RULE-GOVERNED BEHAVIORS UNDER 

A VARIETY OF ENVIRONMENTAL CONDITIONS WHICH REQUIRE 
ADJUSTMENTS OF THE INSTRUCTIONAL BEHAVIORS FOR 
SUCCESSFUL OUTCOMES. 

' FOCUS ON TEACHING PROBLEM SOLVING SEQUENCES 

WHICH CAN BE APPLIED TO A VARIETY OF RESPONSE OR 
SETTING CONDITIONS. 
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4.0 SYSTEMATIC INSTRUCTION 

4.1 FOR LEARNING TO BE EFFECTIVE AND EFFICIENT, INSTRUCTION MUST BE 
STRUCTURED, MEANINGFUL, AND DIRECT. THE SYSTEMATIC INSTRUCTION 
MODEL (LYNCH, MCGUIGAN, & SHOEMAKER, I9d3) PROVIDES A FORMAT 

AND PROCESS FOR MAXIMIZING LEARNING AND INSTRUCTIONAL EFFECTIVENESS, 
IT ALSO PERMITS THE TEACHER TO TRANSLATE MATERIAL DIRECTLY AND 
SYSTEMATICAUY FROM THE lEP (INDIVIDUAL EDUCATION PLAN) TO ACTUAL 
CLASSROOM INSTRUCTION. MANY OF THE SAME COMPONENTS FOUND ON THE 
I.E. P. CAN BE FOUND IN ONE OR MORE OF THE STEPS OF THE SYSTEMATIC 
INSTRUCTIONAL MODEL. 

4.1.1 BEING FAMILIAR WITH THE STEPS IN THE INSTRUCTIONAL 
PROCESS WILL FACILITATE THE ASSESSMENT AND EVALUATION OF 
LEARNER PERFORMANCE. 

4.1.2 THE SYSTEMATIC INSTRUCTION PROCESS CONSISTS OF EIGHT 
ESSENTIAL STEPS (DISPLAY T-4. 1.2). 

<«) ASSESS STUDENT STRENGTHS AND WEAKNESSES. 

- FOR EXAMPLE, BILL WOULD LIKE TO GET HIS 

DRIVER'S LICENSE. WE WOULD FIRST ASSESS WHAT 
•RULES-OF-THE-ROAD" HE ALREADY KHOWS AND CAN 
DEMONSTRATE. WE WOULD ALSO NEED TO EVALUATE 
HIS PREREQUISITE SKILLS, SUCH AS HIS READING 
AUD WRITING ABILITIES, HIS PREVIOUS DRIVING 
r:XPERIENCES AND PRACTICE, ETC. THIS INFORMATION 
irOULD DICTATE WHAT WE WOULD TEACH, AND WHAT 
BILL WOULD HAVE TO LEARN. 



(b) SE^ LONG TERM OBJECTIVES. IDENTIFY INSTRUCTIONAL 
BEHAVIORS TO Be TAUGHT. 

- FOR EXAMPLE, A LONG TERM OBJECTIVF MIGHT FOCUS UN 
BILL'S LEARNING TO NAME TWENTY ROAD SIGNS BY NAME 
AND FUNCTION WHEN THEY ARE PRESENTED ON SLIDES. 

(c) SET SHOPT TERM OBJECTIVES. IDENTIFY INSTRUCTIONAL 
BEHAVIORS FROM A TASK ANALYSIS OF THE LONG TERM OBJECTIVE. 

- GIVEN BILL'S PRIOR LEARNING HISTORY, WE MIGHT 
WANT TO BREAK THE PREVIOUS LONG TERM OBJECTIVE 
INTO FOUR SHORT TERM OBJECTIVES. INSTRUCTIONALLY, 
BILL WOULD FIRST LEARN FIVE BASIC SIGNS. THE NEXT 
OBJECTIVE WOULD REQUIRE HIN TO LEARN FIVE NEW SIGNS 
AS WEIX AS BE ABLE TO RECALL THE FIVE SIGNS FROM THE 
PREVIOUS SHORT TERM OBJECTIVE... ETC. 

(d) WRITE AN INSTRUCTIONAL PLAN. FOCUS ON 
INSTRUCTIONAL MANIPULATIONS TO BE CONDUCTED BY THE 
TEACHER TO TEACH TO THE LONG AND SHORT TERM OBJECTIVES. 
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- GIVEN THE SHORT TERH OBJECTIVES WE'VE 
IDENTIFIED, WE HIGHT DEVELOP AN INSTRUCTIONAL 
PUN THAT REQUIRES BILL TO TAKE A PICTURE OF 
EACH SIGN WITH A POLAROID CAHERA AND TO CREATE A 
l>GSTEB FOR EACH SIGN WHICH DISPLAYS ITS MEANING. 
THIS ACTIVITY HIGHT BE FOLLOWED BY A LESSON 
USING SLIDES OF THE SAHE SIGNS AND REQUIRING 
BILL TO NAHE THE SIGN AND DESCRIBE ITS 
FUNCTION OB HEANING. 

(•) WRITE A HEASUBCHENT PLAN. IDENTIFY WHAT AND HOW 
STUDENT RESPONSES WILL BE ASSESSED AND EVALUATED. 

* THE HEASUREMENT PLAN WOULD CONSIST OF A SIHPLE 
DAILY PROBE THAT REOUIBES BILL TO NAHE ALL 
SIGNS TO WHICH HE HAS BEEN INTRODUCED. 

(f) IMPLEHENT THE INSTRUCTIONAL AND HEASUREHFNT PLANS. 

- ONCE THE ABOVE STEPS HAVE BEEN CQ¥?L£l£[i» WE 
WOULD PUT OUR LESSON ON ROAD SIGNS INTO EFFECT, 
AND WE WOULD IHPLEHENT THE HEASUREHENT PROCESS. 

(g) MODIFY THE INSTRUCTIONAL PLAN BASED ON THE 
STUDENT'S PERFORMANCE DATA. 

- USING THE RULES FOR CHANGE SPECIFIED IN THE 
MEASUREMENT PUN, WE WOULD EVALUATE BILL'S 
PERFORMANCE AND DETERMINE IF INSTRUCTIONAL 
CHANGES ARE NECESSARY OR NOT. FOR EXAMPLE, IF 
BILL LABELED 60X OR LESS OF THE ROAD SIGNS 
CORRECTLY FOR THREE CONSECUTIVE DAYS, WE MIGHT 
CONSIDER CHANGING THE POLAROID AMD SLIDE 
PRESENTATION TO SOME OTHER INSTRUCTIONAL FORMAT. 

<h) EVALUATE THE EFFECTIVENESS OF THE TOTAL INSTRUCTIONAL 
PLAN. 

- THIS STEP ASKS THE TEACHER TO DETERMINE IF THE 
LESSON ACHIEVED WHAT IT WAS SUPPOSED TO FOR 
BILL. WE MIGHT ASK OURSELVES IF WE WOULD USE 
THE LESSON OR ITS INSTRUCTIONAL FORMAT AGAIN. 

4.2 IT IS VERY LIKELY THAT YOU ALREADY ENGAGE IN MANY OF THESE 

INSTRUCTIONAL STEPS IN YOUR WORK WITH HANDICAPPED ADOLESCENTS 
AND YOUNG ADULTS. HOWEVER, WE WANT TO EMPHASIZE THE IMPORTANCE 
OF A SYSTEMATIC APPROACH TO INSTRUCTION FOR HANDICAPPED 
STUDENTS... AND HOW ASSESSMENT AND EVALUATION ARE CRITICAL TO 
THE EFFECTIVE AND EFFICIENT FUNCTIONING OF SYSTEMATIC FORMS OF 
INST.'^UCTION. 

4.2.1 THE REST OF THIS MODULE WILL FOCUS ON ASSESSMENT AND 

EVALUATION OF ACADEMIC AND SOCIAL BEHAVIORS. WE SHOULD 
CONTINUALLY REMIND OURSELVES OF THE DEPENDENT 
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RELATIONSHIP AMONG OUR MEASUREMENT AND EVALUATION 
SYSTEMS, OUR INSTRUCTIONAL METHODS, AND THE LEARNER'S 
PERFORMANCE OR LEARNING. 



5.0 ASSESSMENT AND EVALUATION 



t.l ASSESSMENT AND EVALUATION ARE TWO OF THE MOST IMPORTANT 

COMPONENTS OF INSTRUCTIONAL PROGRAMMING, CURRICULUM SELECTION, 
AND EDUCATIONAL DECISION MAKING. 

5.1.1 IN THIS SECTION OF THE MODULE, WE WILL DISCUSS AND 
REVIEW SOME KEY ASSESSMENT FUNDAMENTALS. 

5. 1.2 INFORMATION FROM THIS SECTION OF THE MODULE WILL SERVE 
AS PRE-REOUISITE KNOWLEDGE FOR PART 3, WHICH FOCUSES ON 
THE ASSESSMENT OF ACADEMIC BEHAVIORS, AND PART 4 WHICH 
EMPHASIZES THE ASSESSMENT OF SOCIAL BEHAVIORS. 

5,2 WHAT ARE ASSESSMENT AND EVALUATION? (DISPLAY T-5.2) 

5.2.1 ASSESSMENT IS DEFINED AS THE MEASUREMENT OF SOME SET OF 
SKILLS, I.E., ACADEMIC OR SOCIAL BEHAVIOR EXCESSES, 
DEFICITS, OR ASSETS. 

(■) WE CAN ASSESS OR MEASURE A VARIETY OF THINGS 

- STUDENT LEARNING, BEHAVIORS, AND PERFORMANCE 

- TEACHER BEHAVIORS, INSTRUCTION, CLASSROOM MANAGEMENT. 

- CLASSROOM INSTRUCTIONAL ENVIRONMENT AND SETTIN3. 

- CHARACTERISTICS OF OTHER SETTINGS, E.G., FAMILY 
OR LIVING ENVIRONMENT, WORK PLACE, ETC. 

<b) THE PURPOSE OF THESE ASSESSMENT DATA AND PROCEDURES 
IS TO ACQUIRE INFORMATION THAT PERMITS THE TEACHER 
AND STUDENT TO EVALUATE CURRENT PROGRESS AND 
INSTRUCTIONAL EFFECTIVENESS. 

- COMMUNICATION 

- ACCOUNTABILITY 

- STANDARDS FOR COMPARISON OR EVALUATION 

- EVALUATION OF INSTRUCTIONAL EFFECTIVENESS AND 
EFFICIENCY 

- IDENTIFICATION, CLASSIFICATION, AND PLACEMENT 

5.2.2 EVALUATION REFERS TO THE DECISION-MAKING PROCESS THAT 
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WE ENGAGE IN WHEN WE USE AND ANALYZE STUDENT 
PERFORMANCE DATA (I.E., ASSESSMENT). 

(•) WE EVALUATE ASSESSMENT DATA IN A VARIETY OF WAYS. 

- WITHIN COMPARISONS, 

E.G., CONPARING A STUDENT'S PREVIOUS PERFORMANCE 
WITH CURRENT LEVELS. 

- BETWEEN COMPARISONS 

E.G., COMPARING A STUDENT'S PERFORMANCE TO SOME 
STANDARDIZED SET OF NORMS OR CRITERIA. 

- FUNCTIONAL COHPARISONS 

E.G., DETERMINING WHETHER AN INSTRUCTIONAL 
PROCEDURE OR INTERVENTION IS EFFECTIVE IN 
CREATING THE DESIRED BEHAVIORAL CHANGE. 

5.2.3 ASSESSMENT AND EVALUATION PROCESSES MAY TAKE ONE OF TWO FORMS 

<«) SUMMATIVE ASSESSMENT AND EVALUATION INVOLVES THE 
MEASUREMENT AND ANALYSIS OF STUDENT LEARNING 
AGAINST A SPECIFIC LONG TERM OBJECTIVE AT THE 
BEGINNING <PRE-TEST) AND AT THE END (POST-TEST) OF 
INSTRUCTION. 

- FOR EXANPLC, WHEN TEACHING A STUDENT A COMPLEX 
SKILL SUCH AS MAP READING, WE MIGHT ADMINISTER A 
PRE-TEST PRIOR TO OUR INSTRUCTION, AND THEN GIVE 
A SIMIUR POST-TEST AFTER OUR INSTRUCTION. THIS 
INFORMATION WOULD ENABLE US TO DETERMINE WHAT 
KINDS OF MAP READING SKILLS THE STUDENT HAD AT 
THE BEGINNING AND END OF A LESSON. 

<b) FORMATIVE ASSESSHENT AND EVALUATION INVOLVE THE 
CONTINUOUS MEASUREMENT AMD ANALYSIS OF STUDENT 
LEARNING AND PERFORMANCE THROUGHOUT THE INSTRUCTIONAL 
PROCESS. 

- IN OUR EXAMPLE ON MAP READING, STUDENT 
PROGRESS WOULD BE MONITORED AND EVALUATED 
THROUGHOUT THE LESSON... NOT JUST AT THE 
BEGINNING AND END OF THE LESSON. THIS 
INFORMATION WOULD TELL US SOMETHING ABOUT THE 
STUDENT'S SUCCESS AND ERROR RATES, AND WOULD 
ALLOW US TO MAKE INSTRUCTIONAL ADJUSTMENTS 
BEFORE THE STUDENT HAS EXPERIENCED TOO MUCH 
FAILURE OR FRUSTRATION. 

<c) DATA-BASED DECISION MAKING IS AN ESSENTIAL ELEMENT OF 
BOTH SUMMATIVE AND FORMATIVE ASSESSMENT/EVALUATION. 

- INSTRUCTIONAL MODIFICATIONS FREQUENTLY OCCUR 
AT THE END OF SOME ADMINISTRATIVE TIME PERIOD 
RATHER THAN ON THE BASIS OF THE PREVAILING 
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RESPONSE PATTERNS OF THE STUDENT. AS IN OUR 
r!!SI!cuL°^ READING, STUDENT LEARNING AND 
INSTRUCTIONAL PROGRAMMING MUST BE ASSESSED AND 
EVALUATED CONTINUOUSLY. SIMILARLY, 
MODIFICATIONS INDICATED BY THESE EVALUATIONS 
MUST BE IMPLEMENTED IMMEDIATELY. EFFECTIVE 
AND EFFICIENT DATA-BASED DECISION MAKING IS 
CHARACTERIZED BY THE FOLLOWING STATEMENTS 
(DISPLAY T-5.2.3). 

- MEASURABLE BEHAVIORS OR EXPECTATIONS ARE 
INDICATED IN BEHAVIORAL OBJECTIVES. 

- BEHAVIORS ARE MEASURABLE. 

- FOR EXAMPLE, IT IS DIFFICULT TO EVALUATE 
>TLL'S KNOWLEDGE OF STREET SIGNS IF WE 

MIT OURSELVES TO HIS 'KNOWING THEM". 
i.w<T, WE CAN BE VERY EFFICIENT IF WE ASK 
HIM TO NAME THE FUNCTION OF A GIVEN SIGN 
VERBALLY AND IN WRITING. 

- ACCEPTABLE ACCURACY LEVELS ARE MEASURABLE. 

- SIMILARLY, IT IS VERY HARD TO DETERMINE 
WHEN BILL HAS MASTERED A SET OF ROAD 
SIGNS WHEN WE STATE THAT HE MUST GET A 
•MAJORITY" OF THEM RIGHT. WHEN WE 
SPECIFY -fi OUT EVERY 10 SIGNS", IT IS 
CLEAR WHEN HE HAS MASTERED A SET OF SIGNS. 

- SPECIFIC AND FUNCTIONAL MEASUREMENT 
PROCEDURES HAVE BEEN WRITTEN. 

- THIS REQUIREMENT IS SIMILAR TO 
SPECIFYING ACCURACY LEVELS. SIMPLY 
STATED, IT IS EASIER TO MONITOR BILL'S 
PROGRESS IF WE MEASURE HIS LEARNING 
SLIDE PRESENTATIONS, RATHER THAN DRIVING 
HIM THROUGH THE STREETS EVERY DAY. 

- THE MEASUREMENT PROCEDURES DIRECTLY 
MEASURE THE INSTRUCTIONAL BEHAVIORS. 

- THIS CONDITION IS RATHER OBVIOUS. IT 
INDICATES THAT WE SHOULD REQUIRE BILL 
TO RESPOND IN A MANNER SIMILAR TO WHAT 
HE WILL BE REQUIRED TO DO WHEN HE TAKES 
HIS DRIVER'S TEST. OUR BEHAVIORAL OBJEC- 
TIVES SHOULD REFLECT THIS REQUIREMENT. 

- THE MFASUREMENT PROCEDURES ARE IMPLEMENTED 
AND IMPLEMENTABLE ON A CONTINUOUS BASIS. 

- OUR MEASUREMENT AND EVALUATION SYSTEMS 
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SHOULD ^LLOW US TO HOttlTOR BILL'S 
PROGBESS ON A COMTINUOUS (I.E., DAILY) 
BASIS. WE WAMT TO BE ABLE TO MODIFY OUR 
INSTRUCTION AND TO CATCH HIS ERROR 
PATTERNS BEFORE THEY BECOME TOO DIFFICULT 
TO CHANGE. 

- BASED ON MEASURABLE CRITERIA INDICATED IN THE 

BEHAVIORAL OBJECTIVE, SPECIFIC AND MEASURABLE RULES 
FOR INSTRUCTIONAL CHANGE MUST BE SPECIFIED, I.E., 
DATA-DECISION RULES. 

- THESE DATA'DCCISION RULES SHOULD BE EXPRESSED IN 
THE FORM OF • IF THEN" STATEMENTS. 

- FOR EXAMPLE, 'IF BILL BALANCES HIS 
PERSONAL CHECKBOOK ACCURATELY EACH DAY FOR 
THREE CONSECUTIVE DAYS, HOVE TO THE NEXT 
INSTRUCTIONAL OBJECTIVE. " 

- 'IF BILL INCORRECTLY BALANCES HIS 
PERSONAL CHECKBOOK EACH DAY FOR THREE 
CONSECUTIVE DAYS, CHANGE THE INSTRUCTIONAL 
OBJECTIVE TO A MORE ACCOMPLISHABLE LEVEL. * 
I.E., GIVE HIM ANOTHER STUDENT'S PERSONAL 
CHECKBOOK TO USE AS A MODEL. 

- A RULE SHOULD BE SPECIFIED FOR ACCEPTABLE 
STUDENT PERFORMANCE, I.E.. WHEN PERFORMANCE 
TRENDS OR PATTERNS INDICATE THAT THE STUDENT 
WILL ACHIEVE THE BEHAVIORAL OBJECTIVE BY THE 
SPECIFIED TIME UNDER THE PREVAILING 
INSTRUCTIONAL CONDITIONS. 

- A RULE SHOULD BE SPECIFIED FOR UNACCEPTABLE 
STUDENT PERFORMANCE, I.E., WHEN ^ ''FORMANCE 
TRENDS OR PATTERNS INDICATE THAT THE STUDENT 
WILL NOT ACHIEVE THE BEUAVIORAI OBJECTIVE BY 
THE SPECIFIED TIME UNLESS (a) 1n£ TIMELINE IS 
EXTENDED AND/OR (b) THE INSTRUCTIONAL 
PROGRAMMING IS ADJUSTED. 



6.0 KINDS OF ASSESSMENT 



6.1 COLLECTING AND MEASURING STUDENT PERFORMANCE CAN BE 

ACCOMPLISHED IN A VARIETY OF WAYS. BASICALLY, WE CAN 
IDENTIFY FOUR BASIC LEVELS OF ASSESSMENT. (DISPLAY T-6.1) 

6.1.1 LEVEL ONE CONSISTS OF WRITTEN DOCUMENTS OR ARCHIVES 
ABOUT PAST S'rUDENT PERFORMANCE AND/OR INSTRUCTIONAL 
STRATEGIES. ZSE MOST FREQUENTLY TAKE THE FORM OF 
WRITTEN REPORTS AND RECORDS. 
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6.1.2 LEVEL TWO / :SSMENT FOCUSES ON INFORMATION COLLECTED 
THROUGH INT^^ IWS AND VERBAL REPORTS. THESE TYPES OF 
DATA ARE OB'i \.£D BY ASKING OTHERS WHO HAVE WORKED WITH 
A PARTICULAR STUDENT OR WHO ARE FAMILAR WITH HIS OR HER 
PARTICULAR ACADEMIC AND SOCIAL BEHAVIOR STRENGTHS AND 
*tfEAKNESSES AND EFFECTIVE AND INEFFECTIVE INSTRUCTIONAL 
STRATEGIES. 

6.1.3 FORMAL AND INFORMAL WRITTEN TESTS MAKE UP LEVEL THREE 
ASSESSMENTS. MOST LEVEL THREE ASSESSMENT DEVICES ARE 
STANDARDIZED, NORM-REFERENCED TESTS; HOWEVER, MORE 
INFORMAL, CURRICULUM-BASED TESTS ARE BEING USED. THE 
LATTER MAY BE OBTAINED THROUGH THE USUAL COM^'.ERCIAL 
VENDOR, OR THEY MAY BE TEACHER MADE. CHECKLISTS AND 
OTHER FORMS OF BEHAVIORAL OR INSTRUCTIONAL I.^VENTORIES 
ARE ALSO INCIiiDED IN THIS LEVEL OF ASSESSMENT. 

6.1.4 THE LAST, MOST DIRECT, AND OBJECTIVE LEVEL OF ASSESSMENT 
INCLUDES DIRECT OBSERVATIONAL TECHNIO'^ES. PROCEDURES 
EMPLOYED AT THIS LEVEL RELY ON THE TEa:HER MAKING DIRECT 
OBSERVATIONS OF BEHAVIORS AS THEY ARE OCCURRING AND 
RECORDING THEM DIRECTLY IN SOME SYSTEMATIC MANNER. 

- IT IS THIS LEVEL OR ASSESSMENT THAT WE WILL BE 

EMPHASIZING IN THIS MODULE, ESPECIALLY WITH RESPECT 70 
THE ASSESSMENT AND EVALUATION OF SOCIAL SKILLS. 



7.0 ASSESSMENT GUIDELINES 



7.1 WHEN DEVELOf. 3 ASSESSMENT MATERIALS AND PROCEDURES, IT IS 
IMPORTANT THAT THE ASSESSMENTS OF PERFORMANCE ARE AS SYSTEMATIC 
AND OBJECTIVE AS POSSIBLE. 

7. 1. 1 THE GOAL IS TO MAXIMIZE YOUR CONFIDENCE IN THE APPROPRIATE- 
NESS OF THE RESULTS FOR THEIR INTENDED USE OR PURPOSE. 

7.1.2 IN THIS SECTION OF THE MODULE, WE WILL DISCUSS A SIMPLE 
FOUR STEP SEQUENCE. 

7.2 STEP ONE: DESCRIBE THE ASSESSMENT SITUATION (DISPLAY T>7.2) 
7. 2. 1 WHAT IS THE REASON FOR ASSESSMENT? 

(a) manage:ient decisions 

- IDENTIFY STULl:NT STRENGTHS AND WEAKNESSES 

- MATCH APPROPRIATE INSTRUCTION AND CURRICULUM TO 
STUDENT NEEDS 

- DETERMINE CURRENT LEVEL OF FUNCTIONING AND 
PREDICT FUTURE PERFORMANCE 
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(b) SELECTION DECISIONS 

- DETERHINATION OF APPROPRIATE PROGRAM PLACEMENT, 
MODIFICATION, OR SERVICE DELIVERY REQUIREMENTS 

(c) PROGRAMMATIC DECISIONS 

- DETERMINATION OF OVERALL ACHIl ^MENT LEVEL OF 
STUDENTS IN PROGRAM. 

- DETERMINATION OF PROGRAM .OMPONENTS REQUIRING 
MODIFICATION 

- DETERMINATION OF PROGRAM ADDITIONS, DELETIONS, 
OR EXPANSIONS 

7.2.2 WHO WILL CONDUCT THE ASSESSMENT AND WHO ARE THE 
DECISION-HAKERST 

7.2.3 WHAT KNOWLEDGE AND/OR SET OF SKILLS WILL BE ASSESSED? 

(■) RELATED TO THIS QUESTION IS "WHAT PREREQUISITE 
SKILLS ARE BEING ASSUMED? 

7.2.4 WHO ARE THE STUDENTS TO BE TESTED? 

(•) AGE/C;)ADE| NUMBER) HAJOR LEARNING INTERFERENCE, 
AND OTHER RELATED CHARACTERISTICS 

7.3 STEP 2: PLAN THE TEST EXERCISE 

7.3.1 I.E., DESCRIBE THE TASKS PLANNED TO SAMPLE STUDENT SKILLS 
(•> DESCRIBE THE TEST ACTIVITY 

(b) DETERMINE WHETHER TO TEST FORMALLY OR INFORMALLY 

(c) DETERHINE THE NUMBER OF PERFORMANCE SAMPLES 
REQUIRED 

(d) DETERMINE WHO WILL SUPERVISE THE ASSESSMENT 

7.3.2 UNDER WHAT CONDITIONS WILL STUDENT PERFORMANCE BE 
ASSESSED? 

(•) IN THE CLASSROOM BY OBSERVING EVERDAY ACTIVITIES? 

- ARE THESE ACTIVITIES READILY AVAILABLE? 

- ARE RESOURCES AVAILABLE TO DEVELOP THE 
ASSESSMENT PROCEDURES ANi^ MATERIALS AND TO 
CONDUCT THE ASSESSMENT? 

- DO THE EVERYDAY SETTINGS PROVIDE SUFFICIENT 
^ OPPORTUNITIES FOR THE DESIRED BEHAVIOR? 
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- CAN THE SETTING BE USED TO ASSESS MORE THAN ONE 
BEHAVIOR OR SETTING? 

(by DESIGN A SPECIFIC TEST EXERCISE AND SITUATION THAT 
SIMULATES THE DESIRED PERFORMANCE CONDITIONS. 

- CAN THE DESIRED SIMULATION BE REALISTICALLY 
CREATED? 

- are resources available to develop and evaluate 
t;ie exercijes? 

' does the test exercise or situation allow each 
student an opportunity to respond to the same 
test activity? 

7.3.3 how many assessment tasks or samples of performance are 
needed to judge a student's skill? 

(1) design one assessment device or procedure and apply 
repeatedly. 

(b) design and use several different assessments to 
assess the same performance skill at one time. 

(c) use different assessments over time. 

(d) SUGGESTIONS 

- GATHER AS MUCH ASSESSMENT MATERIALS AS REQUIRED 
FOR THE INTENDED PURPOSE. 

- GATHER SUFFICIENT DATA TO ENABLE OBJECTIVE AND 
VALID EVALUATIONS. 

- REPEATED MEASURES OVER TIME HAVE THE ADVANTAGE OF 
SHOWING CHANGE OR TRENDS OVER TIHE. THEY CAN 
PROVIDE A PICTURE OF THE LEARNING OR BEHAVIOR 
CHANGE PROGRESS. 

7.3.4 WHO WILL SUPERVISE OR ADMINISTER THE ASSESSMENT ACTIVITY? 

(a) CONSIDER TEACHER SUPERVISED, 

' IF STUDENT HAS A VESTED INTEREST IN DEMONSTRATING 
HIGH PERFORMANCE FOR THE TEACHER, I.E., FOR GRADES. 

- IF STANDARDIZED TESTING CONDITIONS ARE Rf.QUIRED. 

- IF TEACHER OR AIDE HAS THE TIME. 

" IF A SKILLED PERSON IS REQUIRED TO ADMINISTER OR 
EVALUATE PERFORMANCE. 

(b) CONSIDER UNSUPERVISED CONDITIONS 
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- IF STUDENTS HAVE NO REASON TO MISREPRESENT THEIR 
PERFORHANCE. 

" IF STANDARDIZED TESTING CONDITIONS ARE NOT REQUIRED. 

- IF INSUFFICIENT TIME IS AVAILABLE FOR SUPERVIS^ID 
OR INDIVIDUALIZED ADMINISTRATION. 

- IF PERMANENT PRODUCTS RESULT FOR LATER SCORING OR 
ANALYSIS. 

4 STEP 3t DESCRIBE THE PEBFORNANCiC TO B£ EVALUATED 

7.4.1 WHAT KIND OF PERFORMANCE VILL BE EVALUATED? 
<«} THE OUTCOME OR PRODUCT OF BEHAVIOR. 

- USE IF A LASTING TANGIBLE PRODUCT RESULTS 

- USE IF OUALTITY OF PERFORMANCE IS MORE IMPORTANT 
THAN QUANTITY OR SPEED 

- USE VITH TIME TO HAVE SOME RECORD OF PROFICIENCY 
OR FLUENCY 

<b) THE ACTUAL BEHAVIOR OR PERFORMANCE 

- USE IF PROCESS OR ACTION IS MORE IMPORTANT THAT 
PRODUCT OF BEHAVIOR. 

- USE VHEN RATE AND/OR QUALITY OF PERFORMANCE IS 
IMPORTANT. 

- USE VHEN CONDITIONS UNDER WHICH BEHAVIOR OCCURS 
IS IMPORTANT. 

- USE WHEN TIME AND RESOURCES ARE AVAILABLE TO 
CONDUCT PROCEDURES. 

7.4.2 WHAT ASPECTS OF THE BEHAVIOR OR PERFORMANCE SKILL WILL 
BE EVALUATED? 

(•) FOR A DIRECTLY OBSERVED BEHAVIOR OR SKILL EXAMINE 
ITS DIMENSIONS 

- RATE OR FREQUENCY 

- DURATION OR LENGTH 

- LATENCY OR INITIATION TIME 

- LODiS OR LOCATION 

- FORCE OR INTENSITY 

- TOPOGRAPHY OR SHAPE 

- ACCURACY OR STANDARD 

- FUNCTIONAL EFFECT OR RESULT 
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(b) SUGGESTIONS 

- DEFINE PERFORMANCE CRITERIA OR DIMENSIONS PRIOR 
TO ADMINISTERING THE ASSESSMENT. 

- FOCUS ON OBSERVABLE BEHAVIORS. 

- WITH PRODUCTS, FOCUS ON QUALITY AND ATTRIBUTES. 

- BE CERTAIN THAT MEASUREMENT UNIT MATCHES RELEVANT 
DIMENSION OF THE SKILL, PERFORMANCE, OR PRODUCT. 

7.4.3 WILL THE ASSESSMENT BE INOBTRUSIVE OR PUBLIC? 

<i) PUBLIC ASSESSMENT PROCEDURES ARE ASSOCIATED WITH 
A VARIETY OF REACTIVE EFFECTS. 

- MOTIVATION 

- COMPETITION 

- STRESS AND ANXIETY 

(b) SUGGESTIONS AND CONSIDERATIONS 

- CONSIDER PRIVACY RIGHTS OF STUDENT 

- CONSIDER NATURAL VS. CONTRIVED 
PERFORMANCE EFFECTS 

- CONTROL FOR ANXIETY 

7.5 STEP 4: DESIGN A PLAN FOR RATING AND RECORDING PERFORMANCE 
7.S. 1 HOW WILL THE ASSESSMENT DATA BE USED? 

(a) WILL ACTUAL STUDENT PERFORMANCE DATA BE USED? 

' USUALLY MOST USEFUL FOR DIAGNOSIS, SKILL MASTERY 

ASSESSMENT, EVALUATION OF INSTRUCTIONAL EFFECTIVENESS. 

(b) WILL STUDENT PERFORMANCE BE SUMMARIZED OR MANIPULATED? 

- APPLYING A STATISTIC, I.E., MEAN, MEDIAN 

- STANDARDIZATION OF DATA, I.E., PERCENTILES, 
STANDARD SCORES, ETC. 

- USUALLY MOST USEFUL FOR GRADING, GROUPING, AND 
PLACEMENT DECISIONS 

(c) CONSIDERATIONS 

- RESOURCES AVAILABLE TO OBSERVE, SUMMARIZE, RATE, 
AND MANIPULATE PERFORMANCE DATA 
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7.5.2 WHO WILL RATE OR EVALUATE PERFORMANCE? 
(•) CONSIDER TEACHER, IF 

- SPECIALIZED KNOWLEDGE IN ANALYZING STUDL.NT 
RESPONSE OR APPLYING EVALUATION PROCEDURES ARE 
REQUIRED 

- UNIFORM STANDARDS AND HIGH ACCURACY REQUIRED 

• TEACHER HAS TIME AND RESOURCES 

(b) CDNSIDER PEER OR SELF-RATINGS, 17 

' SLIGHT VARIATIONS FROM RATER TO RATER ARE 
ACCEPTABLE 

- STUDENTS HAVE NO VESTED INTEREST IN OUTCOME 

• RESOURCES ARE LIMITED 

- STUDENTS HAVE RECEIVED SOME TRAINING IN PURPOSE 
AND IHPLEMENTATION OF ASSESSMENT AND EVALUATION 
PROCEDURES 

7.S.3 HOW WILL ASSESSMENT DATA BE RECORDED? 

(«) CONSIDER DIRECT OBSERVATION PROCEDURES 

- POTENTIALLY MOST ACCURATE AND OBJECTIVE SINCE 
NO JUDGMENTS OR INDIRECT MEASURES ARE EMPLOYED 

- GIVES DIRECT PICTURE OF PERFORMANCE 

(b) CONSIDER CHECKLISTS OR RATING SCALES 

- COMBINE OBSERVATION WITH EVALUATION 

- EASY TO DEVELOP AND IMPLEMENT 

- USEFUL FOR ESTABLISHING FRAME OF REFERENCE 
FOR UNDERSTANDING PERFORMANCE 

(c) CONSIDER ANECDOTAL RECORDS 

- USEFUL FOR UNIQUE EVENTS OR BEHAVIOR THAT 
CANNOT BE ADAPTED TO SYSTEMATIC MEASUREMENT 
PROCEDURES 

• CAN BE LEFT OPEN-ENDED AND FLEXIBLE 
7.S.4 HOW ARE ASSESSMENT DATA TO BE INTERPRETED? 

(a) COMPARE STUDENT'S DATA WITH THAT OF OTHER STUDENTS 
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- FOR RANKING, GROUPING, GUIDANCE, AND PLACEMENT 
PURPOSES 

(b) COMPARE STUDENT'S DATA WITH A PRE-ESTABLISHED 
STANDARD OR CRITERION OF ACCEPTABLE PERFORMANCE 

- DIAGNOSING AND CERTIFYING SKILL MASTERY 
' EVALUATING INSTRUCTIONAL EFFECTIVENESS 

(c) COMPARE STUDENT'S DATA WITH SELF. 

- SHOW LEARNER PROGRESS AND TRENDS OVER TIME 

- MAKE PREDICTIONS ABOUT FUTURE PERFORMANCE 

id) COMPARE STUDENT'S PERFORMANCE AGAINST STANDARDS 
ESTABLISHED BY SOCIAL ENVIRONMENT 

- SOCIAL VALIDATION, I.E., MEETING EXPECTATIONS 
OF OTHERS, E.G., PARENTS, WORK SETTING, ETC. 



8.0 TECHNICAL ASPECTS OF ASSESSHENT 
(ADAPTED FROM SALVIA & YSSELDYKE, 1984) 

8. 1 THE EVALUATION OF THE TECHNICAL ASPECTS OF ASSESSMENT PROCEDURES 
AND INSTRUMENTS REQUIRES THAT CERTAIN PREREQUISITES BE CONSIDERED 
(DISPLAY T-8. 1). 

8. I. I CLEAR STATEMENT OF PURPOSE 

(«) WHAT DECISIONS TO BE MADE 

(b) WHO THE DECISION HAKER WILL BE 

(c) mkl SKILLS WILL BE ASSESSED 

8.1.2 CLEAR COMMUNICATION DF PURPOSE OF TEST (INSTRUCTIONS) 

(a) EXPLAIN WHAT AND HOW TEST TO BE TAKEN 

(b) SPECIFICATION OF EXPECTATIONS ABOUT PERFORMANCE 

8.1.3 BIAS FREE - I.E., TEST STUDENT PERFORMANCE DO NOT 

REFLECT BIASES OR ATTITUDES OF EVALUATOR 

(a) CONTROL FOR SEXUAL, RACIAL, CULTURAL, ETC. DIFFERENCES 
(b> PROVIDE EQUAL PERFORMANCE OPPDRTUNITIES FOR ALL 

(c) USE EXPLICIT AND PERFORMANCE BASED TRAINING AND SCORING 
CRITERIA 

(d) WRITE IT DOWN... DON'T DEPEND ON A MENTAL NOTEBOOK APPROACH 

(e) WHEN PDSSIBLE, RATE EACH STUDENT "BLIND*. . . I. E. , 
WITHOUT KNOWLEDGE OF STUDENT IDENTITY 
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(f) TEST IK STUDENT'S PRINAftY LANGUAGE. 

a. 2 CONFIDENCE 

Q.2.1 WHENEVER WE ASSESS A STUDENT'S PERFORHANCE, EITHER 

INDIRECTLY OR DIRECTLY, WE HUST CONCERN OURSELVES WITH 
TWO CRITICAL ISSUES 

(■) THE SENSITIVITY OF OUR MEASURING DEVICES OR PROCEDURES 
(b) THE ACCURACY WITH WHICH WE USE THEH. 

8.2.2 IN THIS SECTION OF THE HODULC, WE WILL EXAMINE SOHE OF 
THE TECHNICAL ASPECTS OF ASSESSMENT AND EVALUTION THAT 
ALLOW US TO HAVE OR NOT HAVE CONFIDENCE IN WHAT AND HOW 
WE HEASURE STUDENT PERFORMANCE. 

8.2.3 WE WILL DISCUSS THE FOLLOWING 
(•) ERROR 

- RELIABILITY 

- STANDARD DEVIATION 

(b) VALIDITY 

(c) NORMS 

8. 3 ERROR 

8.3.1 WHENEVER WE OBSERVE OR HEASURE SOMETHING, SOME DEGREE 
OF ERROR IS ALWAYS PRESENT 

im) THE CONCERN WE MUST ADDRESS IS HOW MUCH ERRb» 

(b) TWO STATISTICS ALLOW US TO EVALUATE THE AMOUNT 
OF ERROR PRESENT kUt THE DEGREE OF CONFIDENCE WE 
CAN PLACE ON THE MEASUREMENT 

- RELIABILITY COEFFICIENTS 

- STANDARD DEVIATIONS 

(c) WE WON'T BE DISCUSSING HOW TO COMPUTE THESE STATISTICS. 
BUT INSTEAD WE WILL ATTEMPT TO UNDERSTAND WHAT THEY 
REPRESENT AND HOW WE CAN USE THEN. 

8.3.2 RELIABILITY COEFFICIENTS (DISPLAY 8.3.2) 

(•) RELIABILITY BASICALLY REFERS TO THE DEGREE OF AGREEMENT 
IN REPEATED MEASURES OR ASSESSMENTS OF SOMETHING. 

* REFLECTION OF HOW DEPENDABU THE ASSESSMENT 
INFORMATION IS. 

(b) THE RELIABILITY COEFFICIENT REFERS TO THE PROPORTION 
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OF VARIABILITY OR ERROR IN A SET OF SCORES THAT REFLECTS 
TRUE DIFFERENCES AMONG THE INDIVIDUALS 
(c) WE CAN DERIVE RELIABILITY COEFFICIENTS IN THREE 
BASIC WAYS 



- TEST-RETEST (INDEX OF STABILITY) 

- ADMINISTRATION OF TEST TO SAME POPULATION 
APPROXIMATELY TWO WEEKS LATER WITH SAME 
INSTRUMENT AND PROCEDURES 

- SCORES FROM BOTH ADMINISTRATIONS ARE CORRELATED 

- MEASURE OF DEGREE OF STABILITY OF INSTRUMENT 
OVER TIME. 



- ALTERNATE-FORM RELIABILITY 

" TWO ALTERNATE FORMS OF AN ASSESSMENT DEVICE 
ARE ADHiNISTERED TO THE SAME POPULATION OF 
STUDENTS 

- TO DETERMINE AT WHAT LEVEL THEY MEASURE SAME 
TRAIT OR SKILLS 

- INTERNAL-CONSISTENCY RELIABILITY 

- IF ALL ITEMS IN A TEST MEASURE THE SAME TRAIT 
OR SKILL, THEN BY SPLITTING THE ITEMS IN 
HALF THE CORRELATION BETWEEN THE TWO HALVES 
SHOULD BE VERY HIGH OR CLOSE TO X. 

(d) ASSESSMENT PROCEDURES WITH RELIABILITY SCORES LESS 
THAN 0.9 (1.0 • TOTAL RELIABILITY) SHOULD BE USED 
WITH GREAT CAUTION. 

- LOW RELIABILITY SOURCES 

- LOW-QUALITY ASSESSMENTS 

- STATE CLEAR PURPOSE AND PERFORMANCE CRITERIA 

- GATHER SUFFICIENT PERFORMANCE SAMPLES 

- SCORE CAREFULLY AND EXPLICITLY 

- POOR TEST ADMINISTRATION PRACTICES 

- MINIMIZE STUDENT AND OBSERVER/TESTER DISTRACTIONS 

- USE UNIFORM EXERCISES, RESPONSES, AND RATINGS 

- CHARACTERISTICS OF THE STUDENT 

- MAXIMIL^ STUDENT MOTIVATION 

- REDUCE TEST ANXIETY 

(•) USES OF RELIABILITY COEFFICIENTS 



id 



ASSE^NT OF EXCEPTIONAL INDIVIDUALS: 



- ESTIMATE TEST'S RELATIVE TREEOOM FROM HEASUREHENT ERROR 

- ESTIMATE OF INDIVIDUAL'S TRUE SCORE 

- TO OETERHIME STANDARD ERROR OF MEASUREMENT 

a. 3. 3 STANDARD ERROR OF MEASUREHENT 

(•) S.E.M. GIVES ESTIMATE OF AMOUNT OF ERROR THAT 

MIGHT BE ASSOCIATED WITH A STUDENT'S *TRUE' SCORE. 

(b) S.E.M. IS BASED ON STANDARD DEVIATION OF THE 
ERROR DISTRIBUTION AROUND A 'TRUE* SCORE. 

<c) MEASUREMENT ERROR IS ALWAYS PRESENT FOR A 

PERSON'S SCORE OR MEASUREMENT OF PERFORMANCE. 

- S.E.M. GIVES INFORMATION ABOUT THE DEGREE OF 
CERTAINITY OR CONFIDENCE YOU MAY HAVE IN 
INTERPRETING OR USING THE SCORE. 

- THE LARGER THE SCORE, THE GREATER THE DEGREE OF 

UNCCBTAINITY THE LESS SURE WE CAN BE ABOUT 

THE PERSON'S SCORE. 

8.4 VALIDITY (DISPLAY 8.4) 

8.4.1 VALIDITY REFLECTS THE EXTENT OR DEGREE TO WHICH A MEASUREMENT 
PROCEDURE MEASURES WHAT IT IS INTENDED TO MEASURE. 

(a) USED TO DETERMINE THE KINDS OF INFERENCES OR USES THAT 
CAN BE MADE FROM A MEASUREMENT OR PERFORMANCE SCORE. 

> FOR EXAMPLE, THE EXTENT THAT BIAS INFLUENCES THE 
MEASUREMENT OF A SKILL. 

(b> VALIDITY IS JUDGED RATHER THAN MEASURED OR CALCULATED 

- BASED ON A WIDE ARRAY OF INFORMATION 

• THE COLLECTION OF THIS INFORMATION IS CALLED VALIDATION 

8.4.2 THREE BASIC KINDS OF VALIDITY 

U) CONTENT VALIDITY * EXAMINATION OF THE 
APPROPRIATENESS OF THE ITEMS USED 

• AP. ROPRIATENESS OF TYPES OF ITEMS INCLUDED 

- COMPLETENESS OP THE ITEM SAMPLE 

- WAY IN WHICH ITEMS MEASURE CONTENT OR SKILL 

<b) CRITERION-RELATED VALIDITY - EXTENT TO WHICH A 

PERSON'S PERFORMANCE ON A CRITERION MEASURE CAN BE 
ESTIMATED FROM THAT PERSON'S TRUE SCORE. 

• CONCURRENT CRITERION-RELATED VALIDITY « 
PREDICTING CURRENT CRITERION SCORES. 
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- PREDICTIVE CRITERION-RELATED VALIDITY = 
PREDICTING CRITERION SCORES AT SOME FUTURE TIME. 

(c) CONSTRUCT VALIDITY « ESTIMATING THE VALIDITY OR 

CONFIDENCE OF THE CONSTRUCT OR HYPOTHESIS THAT MAY 
UNDERLIE A TEST OR SCORE. 

- DETERMINED INFERENTIALLY BY EXAMINING THE 

- DEFINITON OF THE CONSTRUCT 

- THE THEORY BEHIND THE CONSTRUCT 

- EMPIRICAL RESEARCH ON THE CONSTRUCT 

- E.G., INTELLIGENCE, LEARNING ABILITY, SELF- 
CONCEPT, ETC. 

a. 4. 3 GUIDELINES FOR MAXIMIZING VALIDITY 

(a) CLEAR £ \TEMENT OF PURPOSE OF ASSESSMENT. 

(b) CLEAR RELATIONSHIP BETWEEN BEHAVIOR OR PRODUCT 
BEING MEASURED AND THE CHARACTERISTIC OR CONSTRUCT 
BEING EXAMINED. 

(c) USE DIFFERENT ASSESSMENT FORMATS TO MEASURE THE 
SKILL OR BEHAVIOR. 

(d) EMPHASIS DIRECT OBSERVATION OR MEASUREMENT OF BEHAVIOR. 

(e) CONDUCT UNOBTRUSIVE MEASUREMENT PROCEDURES TO 
AVOID REACTIVITY AND BIAS. 

(f ) CLEAR AND OBSERVABLE DEFINITION OF BEHAVIOR OR SKILL. 

- DEFINITION PROCESS SHOULD OCCUR BEFORE ITEMS 
ARE SELECTED, RATHER THAN VICE VERSA. 

(g) CLEAR UNDERSTANDING AND DEFINITION OF ASSUMPTIONS 
AND HYPOTHESIS THAT UNDERLIE DOMAIN TO BE MEASURED. 

a.S NORMS OR REPRESENTATIVENESS 

8.S. 1 TEST SCORES OR MEASURES ARE USED IN A VARIETY OF WAYS 

(a) THEY ARE FREQUENTLY USED TO STANDARDIZE GROUPS 
OF STUDENTS. 

(b> THEY ARE ALSO USED TO EVALUATE A PUPIL'S 
PERFORMANCE AGAINST SOME STANDARD OR NORM. 

8.5.2 WHEN SELECTING OR CONSTRUCTING TESTS, IT IS IMPORTANT 

TO EVALUATE THE REPRESENTATIVENESS OF THE POPULATION OF 
SUBJECTS USED TO NO^M OR STANDARDIZE A TEST. 
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(•) KINDS AND NUHBER OF PEOPLE 

(b) AG£ 

(c) SEX 

(d) GRADE 

(•) CULTURAL BACKGROUND OF PARENTS/FAHILIES 

(f) GEOGRAPHIC FACTORS, E.G., REGIONAL 

(g) RACE 

(h) INTCIXIGENCE/ACHIEVEHENT 
(1) DATE OF NORH DETERMINATION 

(j) SPECIAL POPULATION CHARACTERISTICS, E.G., HANDICAPS 

(k) PROPORTION OF KINDS OF PEOPLE USED 

a.S.3 GUIDLINES 

(•) IF NORIf SAMPLE IS DIFFERENT THAN STUDENT BEING 

ASSESSED, LIMITED GENERALIZATIONS AND COHPARISIONS 
CAN BE HADE WITHOUT QUALIFICATION. 

(b) FOCUS ON WITHIM STUDENT ASSESSMENTS RATHER THAN 
BETHECli STUDENT. 



9.0 BASIC STRATE8ICS FOR ASSESSING ACADCNIC PERFORHANCE 

9.1 IN THIS SECTION, WE WILL EXAMINE SOME BASIC STRATEGIES FOR ASSESSING 
ACADEMIC PERFORMANCE. 

9.1.1 THREE MAJOR ASSESSMENT APPROACHES WILL BE DESCRIBED 
(DISPLAY T-9. 1.1) 

(•) DIAGNOSIS OR WITHIN STUDENT ASSESSMENT 

(b) PEER COMPARISONS OR BETWEEN STUDENT ASSESSMENT 

(c) MASTERY -DOMAIN OR STUDENT/CURRICULUM ASSESSMENT 

9.1.2 THE FOLLOWING DISCUSSIONS ARE NOT INTENDED TO BE COMPREHENSIVE, 
BUT, INSTEAD, REPRESENTATIVE OF THE APPROACH. IT WILL BE YOUR 
RESPONSIBILITY TO APPLY THESE STRATEGIES TO YOUR OWN TEACHING 
SITUATIONS. 

9.2 DIAGNOSIS 

9.2.1 DIAGNOSIS IS DEFINED AS THE DEVELOPMENT OF AN ASSESSMENT 
SITUATION THAT IS DESIGNED TO ANALYZE A STUDENT'S CURRENT 
ACADEMIC SKILLS AND INTERFERING ERROR PATTERNS. 

9.2.2 THE PURPOSE OF DIAGNOSIS IS TO DETERMINE HOW THE STUDENT RESPONDS. 

(■) THIS TYPE OF ANALYSIS REQUIRES THE PRESENTATION OF TEST 
MATERIALS WHICH ARE ESSENTIALLY OPEN-ENDED. 

(b) THE ACTUAL ADMINISTRATION AND SCORING OF THE TEST IS OF 
LESS CONCERN. 
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EXAMPLE: IN MATH, A SERIES OF COMPUTATION PROBLEMS 
WERE DEVELOPED AND PRESENTED ON PAPER. THESE 
PROBLEMS REPRESENTED ALL FOUR OPERATIONS WITH WHOLE 
NUMBERS, FRACTIONS, AND DECIMALS. SAH WAS DIRECTED 
TO SOLVE AS MANY PROBLEMS AS POSSIBLE, TO SHOW ALL 
HIS WORK AND TO LEAVE NO PROBLEMS UNATTEMPTED. HIS 
TEACHER THEN REVIEWED HIS WORK LOOKING FOR 
PARTICULAR PROBLEM TYPES WHICH WERE CONSISTENTLY 
MISSED. PART OF THIS ANALYSIS ALSO INCLUDED 
ASSESSING WHICH PROBLEM TYPES WERE COMPLETED 
WITHOUT ERRORS AND WHICH WERE NOT ATTEMPTED AT ALL. 



9.2.3 THE DIAGNOSIS OF ACADEMIC SKILLS CAN BE VIEWED AS A TWO- 
TIERED APPROACH. 



(1) THE FIRST TIER, OR SURVEY LEVEL, CONSISTS OF THE 
DEVELOPMENT OF MATERIALS THAT SPAN WELL BELOW AND 
WELL ABOVE THE ESTIMATED LEVEL OF PROFICIENCY OF 
THE STUDENT. 



- A NUMBER OF GUIDELINES SHOULD BE CONSIDERED IN 
CONSTRUCTING ACADEMIC TEST MATERIALS. 

- TAKE RANDOM SAMPLES FROM A WIDE RANGE OF PROBLEMS. 

- PRESENT THESE PROBLEMS IN A RANDOM MANNER. 

- TEACHERS SHOULD SIVE DIRECTIONS TO THE STUDENT 
THAT INDICATE THE TEST INCLUDES A WIDE RANGE OF 
DIFFICULT PROBLEMS. 

- STUDENTS SHOULD ALSO BE INFORMED THAT THEY ARE 
NOT EXPECTED TO ANSWER ALL OF THE ITEMS CORRECTLY. 

EXAMPLEj in DEVELOPING A SPELLING TEST FOR SALLY, 
THE TEACHER INCLUDED WORDS THAT RANGED FROM VERY EASY 
TO VERY DIFFICULT. HIGH FREQUENCY, IRREGULAR WORDS 
AND LOWER FREQUENCY, REGULAR WORDS WERE ALSO INCLUDED. 
ENOUGH OF THESE MATERIALS WERE '^—SLOPED (E.G., A TOTAL 
OF 75 WORDS) TO PROVIDE SALLY WITH PLENTY OF OPPORTUNITIES 
TO MAKE MISTAKES. SHE WAS TOLD TO WRITE THE WORDS ON A 
BLANK SHEET OF PAPER WHEN THE TEACHER PRONOUNCED THEM, AND 
TO ATTEMPT EACH WORD EVEN THOUGH SHE MIGHT NOT BE FAMILIAR 
WITH ALL OF THE WORDS. 

(b) THE SECOND TIER CONSISTS OF THE ANALYSIS OF THE SURVEY 
LEVEL ASSESSMENT DATA. 

- THE PURPOSE OF THIS ANALYSIS IS TO FORMULATE AN 
APPROPRIATE AND SPECIFIC FOLLOW-UP ASSESSMENT 

- THAT WILL PINPOINT SPECIFIC CORRECT AND ERROR 
RESPONSE PATTERNS. 
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- THIS ANALYSIS REQUIRES THE DETAILED SPECIFICATION 
OF PARTICULAR ITEH TYPES FROM A WELL-DEFINED 
DOMAIN OF OBJECTIVES. 

- THE DONAIii FROM WHICH ITEH TYPES ^^E DERIVED CAN 
BE DEFINED IN ONE OF TWO HAMNERS. 

(1) ONE APPROACH IS TO TA£X ANALYZE THE SURVEY 
LEVEL STIMULUS MATERIALS. 

- THIS ANALYSIS REQUIRES A TABLE OF 
SPECIFICATIONS CONSISTING OF TWO 

CATEGORlESi 

- THE BEHAVIORAL DIMENSIONS OR RESPONSES 
REQUIRED OF THE STUDENT, AND 

- THE HA'i^itlAL CONTENT WHICH IS RANKED 
FROM DIFFICULT TO PROGRESSIVELY SIMPLER 
MATERIAL. 

- THIS PROCEDURE HAS BEEN PRESENTED BY 
HOWEU AND KAPLAN (1960) (DISPLAY T-9. 2.3b). 

- THE BEHAVIOR OR RESPONSE REQUIREMENTS MOVE 
FROM SIMPLE TO MORE DIFFICULT t 

- IDENTIFY 

- ACCURACY ' PERCENT CORRECT 

- MASTERY " ACCURACY WITHIN CIRCUMSCRIBED 
TIME LIMITS 

- A' '^ATICITY > NASTERY IN THE PRESENCE 
OF DISTRACTORS 

- THE TASK ANALYSIS APPROACH R^UIRES THE 
SYSTEMATIC TESTING OF THE STUDENT IN ALL 
OF THE ABOVE CELLS. 

- FIND THE CELL WHICH IS MOST APPROPRIATE 
FOR THE STUDENT. 

IKdOeLE' IN READING, AN INFORMAL ASSESSMENT 
WAS DEVELOPED FROM A SAMPLING OF A WIDE 
RANGE OF HATERIALS. PAGES WERE COPIED FROM 
A READERS DIGEST) THE SPORTS, SOCIETY, AND 
FROHT PAGES OF A LOCAL NEWSPAPER} PAGES FROM 
»ORE SPECIALIZED MAGAZINES) AND FINALLY 
REFERENCE MANUALS. THESE SAMPLES 
REPRESENTED INCREASINGLY HORE DIFFICULT 
READING MATERIAL. THESE TASKS WERE 
PRESENTED TO JIH, AND HE WAS ASKED TO READ 
FROM THESE MATERIALS AND \AEU DESCRIBE 
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THEIR CONTENT BY ANSWERING MULTIPLE CHOICE 
QUESTIONS, WRITING SHORT ANSWERS, AND 
PARAPHRASING THE AUTHOR. 

(2) IK ;hE SECOND APPROACH, AN ERROR ANALYSIS IS 
CONDUCTED. 



- A REVIEW OF THE STUDENT'S ERRORS IS 
CONDUCTED. 



- THESE ERRORS ARE CLASSIFIED INTO 
PARTICUUR TYFaS. 

- AND MATERIALS ARE DEVELOPED THAT 
CONTAIN THE ITEMS IN ERROR. 

E)(A(f£L£< AFTER BEING PRESENTED ASSESSMENT 
MATERIALS, AN ANALYSIS OF BOB'S ERRORS REVEALED 
DIFFICULTIES WITH SEQUENCED MATERIAL, I.E., IN 
WHICH TWO OR THREE EVENTS WERE DESCRIBED OUT OF 
SEQUENCE. A SET OF PASSAGES WERE THEN DEVELOPED 
WHICH EMPHASIZED SEQUENCES OF EVENTS. BOB WAS ASKED 
TO READ THE PASSAGES AND DESCRIBE THE ORDER OF EVENTS. 
HIS PERFORHANCE WAS ANALYZED TO DETERHINE HIS RESPONSE 
STRATEGICS AND TO PREPARE AN INSTRUCTIONAL PROCEDURE 
TO REMEDIATE THE SEQUENCING DIFFICULTY. 

9.3 PEER COMPARISON OR RELATIVE STANDING 

9.3.1 IN THIS APPROACH TO ACADEHIC ASSESSMENT, THE STU ^^I'S 
PERFORMANCE IS COMPARED TO THE PERFORMANCE OF HIS/HER 
PEERS, AND A DETERMINATION OF RELATIVE STANDING IS MADE. 

(•) THE EMPHASIS IS PLACED ON THE STANDARDIZED 
nDMINISTRATION OF TESTS, THAT IS, 

- A CONSTANT U* 4SUREMENT TASK IS USED, 

- THE ADMINISTRArj^N AND SCORING PROCEDURES ARE 
CONTROLLED AND STANDARDIZED. 

(b) TWO TYPES OF MATERIALS CAN BE USED IN THIS TESTING 
APPROACH. 

- PUBLISHED TESTS 

- THESE TESTS ARE USUALLY DEVELOPED l» TUE 
PRIVATE MARKET AND SOLD THROUGH PUBLISHING AND 
TESTING COHPANIES. 

- THEY USUALLY STAND ALONE AND CONTAIN ALL OF THE 
HATERIALS NEEDED TG TEST AND SCORE THE STUDENT. 

- THEY MAY BE THOUGHT OF AS A FORM OF SURVEY 
LEVEL ASSESSMENT IN THAT 
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- A BROAD RANGE OF HATERIAL IS USUALLY 
INCLUDED, WITH VERY FEW ITEMS WITHIN ANY 
ONE OBJECTIVE OR DOIIAIN AREA. 

- THE IMPORTANT QUESTIONS TO ADDRESS IN THE 
SELECTION OF THIS TYPE OF TEST AREi 

- WHAT ARE THE BEHAVIORS SAHPLEDt 

- WHAT IS THE FORMAT OF THE STUDENT'S RESPONSE? 

- OFTEN A MULTIPLE CHOICE FORMAT IS UTILIZED. 
' FOR WHAT PURPOSE ARE THE RESULTS TO BE USED? 

- THE USE OF PUBLISHED TESTS IS USUALLY 
LIMITED TO THE DETERMINATION OF 
GENERAL PLACEMENT DECISIONS. 

- IS THE NORMATIVE GROUP APPROPRIATE? 

- IS THE TEST TECHNICALLY ADEQUATE, I.E., 
RELIABLE AND VALID? 

EXAMPLES HR. JACXSON WANTED TO FIND OUT THE 
RELATIVE LEVEL OF SKILL PROFICIENCY OF THE 
STUDENTS IN HIS MATH CUSS. HE SELECTED THE SRA 
MATH ACH2EVEJIENT TEST BECAUSE (al IT INCLUDED 
BOTH COMPUTATION PROBLEMS AS WELL AS STORY 
PROBLEMS, (bl IT WAS WELL NORMED, AND (ol IT WAS 
BOTH RELIABLE AND VALi:). HE SECURED ENOUGH 
COPIES OF STUDENT PROTOCOL OR ANSWER TORMS AND A 
COPY OF DIRECTIONS TO ADMINISTER THE TEST FROM 
SRA. HE THEN REVIEWED THE TEST, PRACTICED ITS 
ADMINISTRATION, AND ON MONDAY GAVE THE TEST TO 
HIS CLJ^rS. AFTER HE SCORED THE TESTS, HE 
CONVERTED THEM TO A STANDARD SC3RE, USINO A 
TABLE AT THE BACK OF THE ADMINISTRATION MANUAL. 

STANDARDIZED* TEACHER MADE TESTS 

IN THIS CASE, ^STANDARDIZED* REFERS TO THE 
CONSISTENCY OF THE ADMINISTRATION AND SCORING OF 
THE TEST... NOT TO WHETHER OR NOT IT IS NORM- 
REFERENCED OR PUBLISHED. 

A 'STANDARDIZED* TEACHER-MADE TEST MAY BE 
CONSTRUCTED IF THE FOLLOWING GUIDELINES ARE 
SATISFIEDi 

- THE TEST ADMINISTRATION DIRECTIONS AND SCORING 
RULES MUST BE SPECIFIED IN AN EXPLICIT AND CLEAR 
FASHION. 

- A SCRIPTED SET OF INSTRUCTIONS SHOULD BE CONSIDERED. 
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' ALL STUDENT RESPONSE PROTOCOLS SHOULD BE DEVELOPED 
A PRIORI WITH A GUIDF FOR SCORING THE RESPONSES. 

- RESULTS SHOULD BE QUANTIFIED AND REPORTED IN A 
MANNER THAT POSITIONS OR DESCRIBES THE STUDENT 
IN REFERENCE TO AN APPROPRU'^E GROUP. 

EXAMPLE! MS. NELSON RANDOMLY SELECTED 100 
t QMMONLY USED WORDS FROM THE AMERICAN HERITAGE 
WORD FREQUENCY BOOK. SHE CREATED SENTENCES IN 
WHICH THESE VORDS WOULD BE NEEDED, BUT WERE NOT 
INCLUDED (PROVIDING A FORM OF A CLOZE-LIKE TEST). 
A TOTAL OF 100 SUCH SENTENCES WERE DEVELOPED AND 
TYPED ONTO FIVE SHEETS OF PAPER. SHE THEN WROTE 
A SET OF DIRECTIONS THAT SPECIFIED TWO THINGS^ 

FIRST, A OELERAL SET OF CONSIDERATIONS IN 
KwMINISTERING THE TEST, E.G., THE NUMBER OF 
STUDCNTS TO TEST. THE FORMAT OF THE TESTING 
SITUATION. ETC. SECOND. SHE WROTE OUT EXACTLY 
WHAT THE TESTER SHOULD SAY TO THE STUDENTS. 
FINAUY, SHE INCLUDED A SCORING KEY FOR 
DETERMINING THE ACCURACY OF THE STUDENT'S 
RESPONSES. THIS KEY ALSO INCLUDED A CONVERSION 
OF THE STUDENT'S SCORE TO AN APPROPRIATE METRIC, 
WHICH MADE THE SCORE COMPARABLE ACROSS ANOTHER 
GROUP OF STUDENTS AND SIMILAR TIME PERIOD. 

9.4 DOMAIN REFERENCED TESTING 

9.4.1 THE THIRD FORM OF ACADEMIC ASSESSMENT IS DOMAIN- 
REFERENCED TESTING. 

<«) THIS APPROACH IS CHARACTERIZED BY THREE PRINCIPAL 
COMPONENTS. 

- A WELL-DEFINED DOMAIN FROM WHICH ITEMS ARE SAMPLED. 

- A PROCEDURE FOR SAMPLING THE ITEMS. 

- A CRITERION FOR DETERMINING MASTERY. 

(b) CRITERION-REFERENCED AND DOMAIN -REFERENCED ARE TERMS 
WHICH CAN BE USED INTERCHANGEABLY. 

- WHEN CRITERION-REFERENCED IS USED, 'CRITERION- 
REFERS TO THE MEASUREMENT AREA IN WHICH THE 
EVENTUAL PREDICTION OR COMPARISION WILL BE MADE. 
IT DOES NOT REFER TO THE STANDARD OR LEVEL OF 
SUCCESSFUL FUNCTIONING FOR MASTERY. 

<c) THE PURPOSE OF THIS TYPE OF TEST IS TO ASSESS A STUDENT'S 
PERFORMANCE ON OR LEARNING OF PROGRAM CONTENT. 

- IF CONSTRUCTED APPROPRIATELY, DOMAIN-REFERENCEO 
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TESTS CAN BE EXTRCHELY SENSITIVE TO A STUDENT'S 
LEARNING OF PROGRAM CONTENT AND TO LEVELS OF 
CHANGE WITHIN SHORT PERIODS OF TIME. 

- THIS TYPE OF T£ST IS FREOUCNTl; USED TO DETERMINE 
PROGRESS WITHIN A CURRICULim. IF A STUDENT 
SUCCESSFUU.Y PASSES A CONTENT UNIT, THE STUDENT 
MOVES TO THE NEXT UNIT. 

EXAMPLE} HE. JOHNS WANTED TO TEST HIS CLASS ON 
ALL KEY VOCABUURY TERMS USED IN A UNIT ON 
BANKING. HE SYSTEMATICALLY WROTE DOWN ALL WORDS 
IN THE LESSON. A TOTAL OF FIFTEEN WOR.'^S WERE 
IDENTIFIED AI.D INCORPORATED INTO A WORD 
DEFINITION TEST» VHICH HE USED FOR BOTH A PRE- 
TEST AND A POST-TEST. 

(d) HOW IS A "PASSING' SCORE OR ACCEPTABLE LEVEL OF 
PERFORMANCE DETERMINED? 

- A VARIETY or STRATEGIES CAN BE USED IN 
ESTABLISHING A MINIMUM MASTERY SCORE. 

- ESTABLISH THE SCORE BASED ON PERFORMANCE 
OF STUDENTS WHO ARE KNOWN TO BE SUCCESSFUL. 

- APPROXIMATE A SCORE (E.G.» 90X) BASED ON CURRENT 
LEARNING OR PERFORMANCE RATES. 

- GIVE THE TEST TO A GROUP OF STUDENTS AND 
ESTABLISH THE PASSING SCORE AS THE MEDIAN OR 
75TH PERCENTILE OF THESE STUDENTS. 

- IDENTIFY LEVELS OF PERFORMANCE FROM THE NATURAL 
ENVIRONMENT THAT ARE NECESSARY FOR SUCCESS IN 
THOSE ENVIRONMENTS. 

' HOW ARE ITEMS SELECTED FOR CRITERION-REFERENCED TESTS? 

- SAMPLE ALL ITEMS. 

- THIS STRATEGY IS ACCEPTABLE IF THE DOMAIN IS LIMITED 
AND MANAGEABLE. 

- SAMPLE REPRESENTATIVE ITEMS. 

- THIS STRATEGY IS APPROPRIATE WHEN DUPLICATION 
OF SEVERAL ITEMS IS PRESENT IN THE TOTAL DOMAIN. 

- FOR EXAKPL!:, IF THE SKILL BEING TESTED 
IS VOWEL DIAGRAPHS (EA, EE, IE, OU), 
NOT ALL WORDS INCLUDING THESE DIAGRAPHS 
NEED TO BE INCLUDED. RATHER, THE TEST 
WOULD INCLUDE A CERTAIN NUMBER OF WORDS 
WITH EACH OF THE DIAGRAPHS. 
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- RANDOM SAMPLING 

- THIS STRATEGY IS NECESSARY WHEN THE 
DOMAIN IS SUFFICIENTLY LARGE TO PRECLUDE 
EITHER OF THE ABOVE TWO STRATEGIES. 



10.0 WHAT TO ASSESS 

10. 1 IN THIS SECTION, WE WILL DISCUSS STRATEGIES AND GUIDELINES FOR 
DEFINING THE ITEM SELECTION PROCEDURE (ADAPTED FROM HOPKINS 
AND ANTES, 1976) 

10.1.1 SINCE THE CONTENT OF ASSESSMENT OR CURRICULUM IS 
DISCUSSED IN A SEPARATE MODULE, IT WILL NOT BE EMPHASIZED. 

(■) THE FOCUS WILL BE PLACED ON SELECTING ITEM 
FORMATS FOR ASSESSING THE CURRICULUM. 

10.1.2 WE WILL DISCUSSi 

(■) SELECTION TYPE ITEMS 
(b) AND SUPPLY TYPE ITEMS 

10. 2 SELECTION TYPE 

10.2.1 SELECTION TYPE ITEMS ARE SELF-CONTAINED AND DO NOT 
ALLOW THE STUDENT TO GO BEYOND THE ITEM IN ANSWERING 
THE PROBLEM. 

10.2.2 MULTIPLE CHOICE 

(■> MULTIPLE CHOICE ITEMS MUST BE ANSWERED BY 
SELECTING A RESPONSE FROM A SET OF POSSIBLE 
(ALTERNATIVE) RESPONSES. 

(b> MULTIPLE CHOICE ITEMS CONSIST OF TWO BASIC 
COMPONENTS i 

- A STEM (OR STIMULUS) WHICH THE STUDENT MUST 
USE TO IDENTIFY AN APPROPRIATE AND COMPLETING 
RESPONSE 

- AND A SET OF ALTERNATIVES ( DISTRACTORS ) FROM 
WHICH THE CORRECT RESPONSE MUST BE SELECTED. 

(c> THE ADVANTAGE IS EASE IN SCORING. 

- THE DISADVANTAGE IS THE INVESTM^'NT REQUIRED TO 
CONSTRUCT THE TEST. 

(d) MULTIPLE CHOICE ITEMS ARE USEFUL FOR LITERAL 
COMPREHENSION AND APPLICATION. 



- THEY ARE LESS USEFUL FOR THE ASSESSMENT OF 
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ANALYSIS, SYNTHESIS, OR EVALUATION SKILLS. 

(•) THE FOLLOWING GUIDELINES SHOULD BE FOLLOWED IN 
CONSTRUCTING MULTIPLE CHOICE TYPE ITEMS. 

- PROVIDE EXTENSIVE DIRECTION IN ANSWERING THE ITEH. 

- SELECT DISTRACTORS OR ALTERNATIVES SO THEY 
REPRESENT THE RANGE OF POSSIBLE RESPONSES. 

- CLEARLY PRESENT THE TASK AND THE EXPECTED RESPONSE. 

- USE A QUESTION IN THE STEH WHENEVER POSSIBLE. 

- LIST THE ALTERNATIVES IN A COLUMN. 

- AVOID THE USE OF NEGATIVES IN THE STEH. 

- ENSURE THAT ALL ALTERNATIVES ARE CONSTRUCTED 
IN A PARALLEL MANNER. 

- AVOID CLUES IN THE ALTERNATIVES. 

- USE DISTRACTORS OF EQUAL DIFFICULTY FOR THE 
NAIVE STUDENT. 

- AVOID TRICK QUESTIONS. 

- VARY THE SERIAL POSITION OF THE CORRECT CHOICE. 
10.2.3 TRUE-FALSE ITEMS 

(•) TRUE-FALSE PRESENTS A DECLARATIVE STATEMENT THAT 
PURPORTS TO BE AN ACCURATE REFLECTION OF THE 
STATE OF SOMETHING. 

- THE STUDENT IS EXPECTED TO AGREE (MARK IT 
'TRUE') OR DISAGREE (MARK IT 'FALSE'). 

(b) A NUMBER OF ISSUES SHOULD BE CONSIDERED WHEN 

CONSTRUCTING AND USING T/F SELECTION TYPE ITEMS. 

- CLEARLY SPECIFY A SITUATION WHICH IS ENTIRELY 
TRUE OR FALSE. 

- CONFINE THE LENGTH AND COMPLEXITY OF THE 

SENTENCE. 10.3 

- AVOID SPECIFIC DETERMINERS ("ALWAYS", "NEVER"). 

- AVOID AMBIGUITY, VAGUENESS, OR OPEN-ENDED ISSUES. 

- HAKE ALL STATEMENTS PLAUSIBLE. 



- DIRECT THE STATEHENT IN A POSITIVE HANNER. 

- AVOID DOUBLE NEGATIVES. 

- USE THE SAHE APPROXIHATE NUHBER OF TRUE AND 
FALSE STATEHENTS. 

10. 2. 4 HATCHING ITEHS 

(^) HATCHING ITEHS INCLUDE A LIST OF STIHULUS 
FEATURES AND POSSIBLE RESPONSES THAT ARE 
RELATED ON ONE-TO-ONE BASIS. THE STUDENT IS 
DIRECTED TO PAIR TKEH TOGETHER. 

(b) WHEN CONSTRUCTING OR USING HATCHING TYPE ITEHS, 
THE FOLLOWING SHOULD BE CONSIDERED: 

- KEEP BOTH LISTS Mni|OG£NEOUS 

- CLEARLY ESTABLISH THE BASIS FOR THE RELATIONSHIP 

- KEEP THE LIST SHORT (FROH 5 TO d ITEHS IN EACH 
LiST) 

- ARRANGE THE LISTS IN A LOGICAL AND ORDERLY FASHION 

- INCLUDE RESPONSES WHICH HATCH HORE THaN ONE 
ITEH OR DON'T HATCH ANY 

- PRESENT BOTH LISTS IN THE SAHE VISUAL FIELD 

- DIRECT THE STUDENT IN WHICH WAY TO HATCH 

10.2. 5 CLASSIFICATION 

(a) CLASSIFICATION TYPE SELECTION ITEHS PROVIDE 
THE STUDENT WITH ELEMENTS OF TWO SETS, AND 
REQUEST A CATEGORIZATION OF ALL HEHBERS OF ONE 
SET WITHIN HEHBERS OF THE OTHER SET. 

(b) WHEN CONSTRUCTING OR USING CLASSIFICATION TYPE 
SELECTION ITEHS, THE FOLLOWING GUIDELINES SHOULD 
BE CONSIDEREDi 

- BE CERTAIN THAT THE SETS ARE HUTUALLY EXCLUSIVE. 

- INCLUDE AN EXHAUSTIVE LIST OF ELEHENTS IN A SET. 
SUPPLY TYPE ITEHS 

10.3.1 SUPPLY TYPE ITEHS DIRECT THE STUDENT TO COHPLETE 

THE RESPONSE BY PROVIDING THE CORRECT ANSWER RATHER 
THAN SELECTING IT. 

(a) THE STIHULUS ITEH PROVIDES VARYING DEGREES OF 
FREEDOH IN STRUCTURING THE STUDENT'S RESPONSE. 



ERLC 



60 



ASS^HENT OF EXCEPTIONAL INDIVIDUALS: 



10.3.2 CLOZE ITEHS 

(•) IN CLOZE SUPPLY TYPE ITEHS, THE STIMULUS ITEM 

CONTAINS ALL BUT A KINIHAL AHOUNT OF INFORMATION 
THAT THE STUDENT IS RCOUESTEO TO COMPLETE. 

- FILL-IN-THE-BLANK TYPE ITEHS ARE HOST 
COHHONLY USED IM THIS TYPE. 

(b) WHEN DEVELOPING OB USING CLOZE SUPPLY TYPE 

ITEHS, THE FOLLOWING ISSUES SHOULD BE CONSIDERED} 

- HAKE CERTAIN ONLY ONE RESPONSE IS CORRECT 
FOR EACH BUNK. 

- INCLUDE ENOUGH INFORHATION IN THE STIHULUS 

TO ENSURE COHPARABILITY ACROSS STUDENT RESPONSES. 

- LEAVE THE BUNK SPACE NEAR THE END OF THE SENTENCE. 

- OHIT ONLY SIGNIFICANT WORDS CENTRAL TO THE AREA 
OF KNOWLEDGE WHICH IS BEING TESTED. 

- USE CONSISTENT SIZE BLANKS ACROSS ALL ITEHS. 

- AVOID STRUCTURING THE ANSWER THROUGH SYNTAX 
(I.E. USE OF SINGULAR/PLURAL). 

10.3.2 SHORT ANSWER 

(•) SHORT ANSWER SUPPLY TYPE ITEMS PROVIDE THE 

STUDENT WITH A QUESTION OR DIRECTIVE TO RESPOND 
WITH A SHORT PHRASE, WITH LITTLE STRUCTURE OR 
CONSTRAINT ON THE CONTENT OF THt ANSWER. 

(b) WHEN USING OR DEVELOPING SHORT ANSWER SUPPLY TYPE 
ITEHS, THE FOLLOWING ISSUES SHOULD BE CONSIDERED: 

- THE QUESTION OR STATEHENT SHOULD SPECIFY A 
CONCISE AND SIHPLE ANSWER. 



- INCLUDE RULES FOR RESPONDING IN THE 
DIRECTIONS DESIRED. 

10.3.3 EXTENDED ANSWERS 

(•) EXTENDED ANSWER SUPPLY TYPE ITEHS PRESENT A 
STIHULUS ITEH IN THE FORH OF A QUESTION OR 
DIRECTIVE AND REQUIRE THE STUDENT TO PROVIDE 
AN EXTENDED ANSWER THAT IS LONGER THAN A 
PHRASE OR ONE SENTENCE. 

- FEW RESTRICTIONS ARE PROVIDED FOR 
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STRUCTURING THE RESPONSE. 

- USEFUL FOR ATTENDING TO 'HIGHER ORDER' 
ISSUES (I.E., ANALYSIS, SYNTHESIS, 
COHPARISONS, AND EVALUATIONS). 

(b) WHEN USING OR WRITING EXTENDED ANSWER ITEHS, 
KEEP THE FOLLOWING GUIDELINES IN HIND. 

- HAKE m STATEHENT OR QUESTION CLEAR AND CONCISE. 

- ROVIDE THE WEIGHTS OR POINTS FOR EACH OF 
THE ITEHS. 

- PROVinE CLEAR DIRECTIONS FOR STRUCTURING THE 
STUDENT'S RESPONSE. 



11.0 HOW TO ASSESS ACADEHIC PCRFORHAHCE 

11.1 IN THIS SECTION, WE WILL DISCUSS SOHE GUIDELINES AND 
CONSIDERATIONS RELATED TO HOW TO ASSESS ACADEHIC PERFORHANCE. 

11.1.1 SOHE OF THIS HATERIAL WAS DISCUSSED BRIEF V IN 

PART 2 OF THIS HODULE, I.E., ASSESSHENT F WDAHENTALS. 

(■) HOWEVER, THE EMPHASIS IN THIS SECTION WILL BE 
ON THE ASSESSHENT OF ACADEHIC PERFORHANCE. 

(b) WE WILL DISCUSS! 

- ADHINISTERING TESTS 

- SCORING TESTS 

- REPORTING THE OUTCOHtS 

11.2 ADHINISTRATION OF THE TEST 

11.2.1 REGARDLESS OF THE TYPE OF TEST BEING ^':..INISTERED 
OR THE SUBJECT AREA BEING ASSESSED, A NUHBER OF 
TEST ADHINISTRATION CONSIDERATIONS SHOULD BE KEPT 
IN HIND TO IHPROVE THE ACCURACY AND UTILITY OF THE 
RESULTS. 

11.2.2 TIHING OF THE TEST 

(a) HANY ASSESSHENTS DO NOT EXAHINE HOW HUCH TIHE 
A STUDENT REQUIRES TO COHPLETE A TEST OR 
ACTIVITY. RATHER HEASUREHENT IS LIHITED TO 
NUHBER OR PERCENT CORRENT AND INCORRECT. 

- LEARNING IS NOT JUST THE ACQUISITION OF 
ACCURATE INFORHATION OR SKILLS. LEARNING 
ALSO INVOLVES THE STUDENT'S FLUENCY OR 
PROFICIENCY AT A TASK OR SKILL. 
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- FOB CXAHPIX, A STUDENT HAY BE lOOX 
ACCURATE AT FILLING OUT A JOB APPLICATION, 
BUT IF IT TAKES THE STUDENT MORE THAN 30 
MINUTES TO COMPLETE IT, S/HE HAY NOT BE ABLE 
TO COHPCTE WITH HONE EFFICIENT APPLICANTS. 

<b) RECORDING HOV LONG IT TAKES FOR A STUDENT TO 
COHPLCTE A SKILL ACCURATELY IS IHPORTAHT FOR A 
NUHBER OF REASONS. 

- HAVING TIHE ALLOWS THE TEACHER TO CALCULATE A 
STUDEHT'S RATE OF PERFORHANCE. THIS CALCULATION 
SIHPLY EXPANDS THE SUHHARY INFORHATION AVAILABLE. 

- FORMULAS « OF BEHAVIORS 

• RATE 

AHOUNT OF TIME 

- E.G., WORDS READ PER MINUTE 

NUHBER OF TASKS COHPLETED PER HOUR 
NUHBER OF WIDGETS ASSEHBLED PER HOUR 

- HAVING TIHE ALLOWS THE TEACHER TO DETERMINE THE 
DURATION OF TIHE REQUIRED TO COHPLETE A TASK. 

- DURATION REFERS TO THE AHOUNT OF TIHE TO 
START AND FINISH A SINGLE TASK OR ACTIVITY. 

- E.G., HOW LONG IT TAKES TO BALANCE A CHECKBOOK. 

• TIHED ASSESSHENTS ALLOW THE TEACHER TC 
EVALUATE RELATIVE PROFICIENCY ACROSS 
STUDENTS . 

- ALLOWING FOR AN EVALUATION OF INSTRUCTIONAL 
EFFECTIVENESS AND EFFIC;ENCY. 

- IT IS POSSIBLE TO EVALUATE WHETHER 

SUFFICIENT "OPPORTUNITY TO RESPOND* HAS 
BEEN PROVIDED FOR BOTH THE HIGHEST AND 
LOWEST PERFORHING STUDENTS. 



11.2.3 DEVELOPING STANDARDIZED DIRECTIONS. 

<•) WHEN ADHINISTERING ACADEMIC ASSESSHENTS, UNIFORH 
DIRECTIONS OR INSTRUCTIONS SHOULD BE PROVIDED. 

(b) THE PURPOSE OF SUCH STANDARDIZATION IS TO: 

- DIRECT THE STUDENTS TO RESPOND TO THE 
ESSENTIAL FEATURES OF THE TEST QUESTION. 
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.E. , THAT THE STUDENT IS 
RESPONDING TO THE RELEVANT FEATURES OF THE ITEM. 

- ENSURE COMPARABILITY AChOSS ALL STUDENTS. 

- THAT IS, TO INSURE THAT NO ONE'S PERFORHANCE 
IS DIFFERENTIALLY AFFECTED BY THE MANNER IN 
WHICH THE TEST IS GIVEN. 

- ENSURE COMPARABILITY ACROSS TIHE. 

- AS TEST RESULTS ARE COHPAREO FROH PRE- TO 
POST-TEST OUTCOHES, THIS STANDARDIZATION OF 
INSTRUCTION ATTEMPTS TO INCREASE THE 
PROBABILITY THAT THE CHANGE IS NOT A RESULT 
OF VARIATION IN ADHINISTRATION. 

11.2.4 PHYSICAL CONDITIONS. 

(1) SINCE THE PURPOSE OF TESTING IS OFTEN TO DETERMINE 

"OPTIHAL PERFORMANCE,* IT IS IMPORTANT THAT PHYSICAL 
CONDITIONS BE CONSIDERED DURIHG ASSESSMENTS. 

- THE VALIDITY OF A TEST If* OFTEN TIMES 
INFLUENCED BY THE CONDITIONS UNDER WHICH THE 
ASSESSMENTS ARE ADMINISTERED. 

(b) THE FOLLOWING FACTORS SHOULD BE CONSIDERED: 

- LIGHTING OF THE ROOM MUST BE ADEQUATE TO READ 
AND WRITE. 

- NOISE MUST BE OF LOW THRESHOLD, PROVIDING AN 
UNDISTURBED ASSESSMENT. 

- INTERRUPTIONS MUST BE AVOIDED TO KEEP THE 
STUDENT'S ATTENTION ON THE TESTING. 

- COMFORTABLE SURROUNDINGS (HEATING AND 
VENTILATION) MUST BE PRESENT TO .HAXIMIZE 
PERFORMANCE. 

- MATERIALS MUST BE PRESENT AND ORGANIZED TO 
MINIMIZE WAITING ON THE PART OF THE STUDENT. 

- THIS IS ESPECIALLY IMPORTANT IN GROUP TESTING 
AND WITH STUDENTS WHO ARE EASILY DISTRACTED 
BY LONG TRANSITIONS OR PREPARATION ACTIVITIES. 

3 SCORING THE TEST 

11.3.1 PRIOR TO THE ACTUAL ADHINISTRATION OF THE TEST, PLANS 
SHOULD BE HADE FOR THE SCORING OF STUDENT RESPONSES. 
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11.3.2 A NUHBES OF ISSUES NEED TO BE CONSIDERED WHEN PLANNING 
FOR THE SCORING OF STUDENT PERFORMANCE ON TESTS OR 
OTHER ASSCSSHENT INSTRUHCNTS. 

(•) WHO WILL SCORE THE TEST? TEACHERS? AIDES? STUDENTS? 

(b) HOW TO SCORE HISSING OR UNANSVERED ITEHS - ARE 
THEY TO BE TREATED AS INCORRECT OR ABSENT? 

(c) WHAT TYPE OF SCORING KEYS VILL BE ESTABLISHED? 

(d) WILL INTER-SCORER RELIABILITY EE DETERMINED? IF 
SO, WHAT PROCEDURES HILL BE USED? 

- THIS SIHPLY i:XAHINES HOW ACCURATE A 3IVEN 
SCORER MIGHT BE. 

11.3.3 IN PREPARING TO SCORE A TEST, IT IS IMPORTANT TO DETERMINE 
THE UNIT OF ANALYSIS. 

* THIS ISSUE REFERS TO THE SIZE OR AMOUNT OF A 
LEARNER'S PERFORMANCE THAT HILL BE USED TO 
DETERMINE A SCORE. 

- THE UNIT OF ANALYSIS IS IMPORTANT IN TERMS OF 
THE SCALING OF THE TEST AND DETERMINING THE 
RANGE OF POSSIBLE SCORES. 

- MANY TESTS MAY COMPRISE SUBUNITS, EACH WITH 

A SUBTOTAL. THE TEACHER WILL NEED TO DETERMINE 
WHETHER THE STUDENT'S SCORE WILL BE REPORTED FOR 
EACH SUBTEST OR SUHMSD ACROSS SUBTESTS AND 
REPORTED FOR THE TOTAL TEST? 

EXAMPLES A STANDARDIZED TEST THAT ACCOMPANIES A 
COMMERCIALLY PREPARED SOCIAL STUDIES CURRICULUM 
CONTAINS FIVE MAJOR UNITS) EACH UNIT HAS FIVE 
ASSESSMENT ITEMS. THE PUBLISHERS STATE THAT 
FOUR CORRECT OUT OF FIVE ARE MSEDED FOR EACH UNIT 
TO BE CONSIDERED PASSING (OR MASTERY). BECAUSE 
THIS SMALL NUMBER OF ITEMS DOES NOT ADEQUATELY 
ASSESS THE CURRICULUM FOR EACH UNIT, SERIOUS 
SCORING, AND VALIDITY PROBLEMS EXIST. SO MR. 
SMITH HAS DECIDED TO BASE MASTERY ON THE TOTAL 
TEST SCORE, USING 21 OUT OF THE TOTAL OF 25 AS 
THE CRITERION FOR MASTERY. 

11.3.4 SCALING PROPERTIES. 

(•> SCALING REFERS TO THE RANGE OF NUMBER OF ITEMS 
USED TO SCORE A STUDENT'S PERFORMANCE. 

(b) THE GUIDING RULE SHOULD BE TO MAXIMIZE THE SCALE 
AS MUCH AS POSSIBLE. 
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EXAMPLE: MR. LIGHT HAS ADMINISTERED A SPELLING 
TEST TO HIS TOP GROUP OF STUDENTS. HE SAMPLED 
WORDS FROM THE NEWSPAPER, ADMINISTERING ONE WORD 
IN ROLLING DICTATION EVERY 10 SECONDS, FOR A 
TOTAL TIME OF 2 MINUTES. HE DECIDED TO SCORE THE 
WORDS BY COUNTING THE NUMBER OF CORRECT LETTER 
SEQUENCES, RATHER THAN THE TOTAL NUMBER OF WORDS 
SPELLED CORRECTLY. THE RANGE FOR THE FORMER 
UNIT (CORRECT LETTER SEQUENCES) WAS 36 TO 223, 
WHILE FOR THE LATTER UNIT (WORDS CORRECT), THE 
SCORES RANGED FROM 6 TO 17. CLEARLY, GREATER 
SENSITIVITY EXISTS WITH CORRECT LETTER SEQUENCES. 
OTHER EXAMPLES INCLUDE THE USE OF CORRECT DIGITS 
VS. PROBLEMS IN MATH, AND NUMBER OF LETTERS 
WRITTEN VS. WORDS IN WRITTEN EXPRESSION. 

11. 3. 5 INSTRUCTIONAL RELEVANCE. 

(a) INSTRUCTIONAL RELEVANCE REFERS TO THE NATURE OF 
THE UNIT FOR SCORING TEST RESPONSES. 

(b) THE UNIT OF BEHAVIOR SHOULD BE MEANINGFUL AND 
HAVE CONTEXT VALIDITY OF ITS OWN. 

EXAMPLES A SAMPLE OF JIM'S WRITING WAS ANALYZED 
TO DETERMINE IF HE HAD ANY SIGNIFICANT "DEFICITS* 
(I.E. HIS WRITING CONTAINED SIGNIFICANTLY SIMPLER 
SYNTAX AND STRUCTURE THAN USED BY AGE/GRADE 
PEERS). HIS WRITING WAS ANALYZED FOR SEVERAL 
VARIABLES: THE NUMBER OF SYLLABEL£S PER WORD, THE 
NUMBER OF MATURE WORDS, THE NUMBER OF CORRECT 
WORD SEQUENCES AND THE MEAN NUMBER OF WORDS PER 
SENTENCE-UNIT. OF ALL OF THESE INDICES, THE LAST 
ONE IS PROBABLY THE MOST CLEARLY RELATED TO A 
MEASURE OF "COMPLEXITY* AND SYNTAX, AND THEREFORE 
HAS INSTRUCTIONAL RELEVANCE. 

11.3.6 SENSITIVITY TO CHANGE. 

(a) TO USE DATA IN THE FORMATIVE EVALUATION OF 

PROGRAMS, IT IS IMPORTATNT THAT THE DATA REFLECT 
CHANGES IN STUDENT PERFORMANCE OVER RELATIVELY 
SHORT PERIODS OF TIME. 

EXAMPLE: IN THE WRITING SITUATION ABOVE, IN WHICH 
A STUDENT'S WRITING SAMPLE WAS SCORED FOR THE 
NUMBER OF WORDS PER SENTENCE -UNIT, A PROBLEM MAY 
EXIST IN HOW SENSITIVE THE MEASURE IS TO PERFORM- 
ANCE CHANGE, ESPECIALLY OVER BRIEF PERIODS OF TIME 
IT IS NOT UNUSUAL TO FIND THAT STUDENTS INCREASE 
THE NUMBER OF WORDS PER SENTENCE-UNIT AT A MAXIMUM 
RATE OF ONLY 1.3 WORDS PER YEAR. INSTRUCTIONAL 
RELEVANCE MAY CONFLICT WITH SENSITIVITY. 

11.3.7 COST-EFFECTIVENESS. 
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(•) CUARLY ALL MEASUREMENT DATA MUST BE USEFUL AND 
USABLE IN A MANNER THAT FACILITATES THEIR 
INCORPORATIJN INTO THE DAILY CLASSROOM ROUTINE. 

(b) THE FOLLOWING RErnbSENT QUESTIONS THAT ASSESS THE 
COST-EFFECTIVENESS OF A MEASUREMENT SYSTEM. 

- HOW MUCH TIME IS TAKEN III THE A0MINISTRAT*3N, 
SCORING AND REPORTING OF THE SCORES? 

- NOV MUCH MONEY IS EXPENDED? 

- WHAT 13 THE IMPACT ON THE PROGRAM FOR MAKING 
DECISIONS WITH AND WITHOUT THE DATA? 
ADVANTAGES? DISADVANTAGES? 

- WHAT ARE THE SHORT- AND LONG-TERM EFFECTS OF 
DAILY ASSESSMENT PROCEDURES? 

- WHAT ALTERNATIVE PROCEDURES ARE AVAILABLE? 
WHAT INFORM VTION WILL BE GAINED OR LOST? 

11.4 REPORTING THE OUTCOME 
11.4.1 USIKG PERCENT 

if PERCENT IS USEFUL FOR TWO BASIC REASONS. 

- MAKES THE DATA ACROSS DIFFERENT TEST OR 
SUBTESTS COMPARABLE WHEN THE NUMBER OF ITEMS 
ARE NOT EQUAL. 

EXAMPLES MR. POE WANTED TO COMPARE JIM'S 
PERFORMANCE ON THE MATH TEST FROM THE LATEST 
UNIT AGAINST HIS TIRFORMANCE ON THE PREVIOUS 
UNIT. JIM'S SCORE WAS THE SAME FOR BOTH TESTS - 
AN OBTAINED SCORE OF 70. HHwevER, THE LATEST 
TEST INCLUDED ONLY 7S ITEMS, WHILE THE EARLIER 
TEST HAD A TOTAL OF 100 ITEMS. TO MAKE A FAIR 
COMPARISON ACROSS TWO SITUATIONS WHICH HAVE 
PRESENTED THE STUDENT DIFFERENT OPPORTUNITIES TO 
RESPOND, MR. POE HAS DECIDED TO USE PERCENT 
CORRECT. JIM'S PERFOHANCE ON THE FIRST TEST WAS 
93 PERCENT CORRECT, AND ON THE LATER TEST, ONLY 
70 PERCENT CORRECT. CLEARLY, HE HAD DONE SETTER 
ON THE PREVIOUS TEST. 

(b) FOCUSES PERFORKANCE ON ACCURACY. 

- PERCENT CORRECT IS ESSENTIALLY A MEASURE OF 
ACCURACY. IT IS CALCULATED BY THE FULLOWING 

FORMULAS 

« CORRECT 




X lOO « X 

/# CORRECT ♦ # INCORRECT 
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(c) WHEN USIN3 PERCENT A NUMBER OF CAUTIONS SHOULD BE 
KEPT IN MIND. 

- PERCENT CAN BE QUITE INSENSITIVE WHEN THERE ARE 
FEWER THAN 10 ITEMS. A ONE ITEM CHANGE WILL 
CAUSE A LARGE CHANGE IN PERCENT. 

- THE DISTRIBUTION OF STUDENTS' SCORES IS NOT 
EVEN, AND NOT DIRECTLY COMPARABLE ACROSS THE 
ENTIRE RANGE OF RAW SCORES. 

- THE DIFFERENCE BETWEEN RAW SCORES NEAR THE 
MIDDLE OF THE DISTRIBUTION (FROM 40-60 
PERCENT) ARE NOT THE SAME AS THE COMP\RABLE 
DIFFERENCE OF THE RAW SCORES NEAR EITHER OF 
THE TAILS (10-20 PERCE*,. AND 90-100 PERCENT). 

11.4.2 USING ;3S0LUTE CORRECT AND INCORRECT SCORES 

<■) WHEN THE NUMBER OF ITEMS A STUDENT GETS CORRECT 

OR INCORRECT IS OF IMPORTANCE, REPORTING STRAIGHT 
CORRECT AND INCOORECT RAW SCORES MAY BE USEFUL. 

- ESPECIALLY USEFUL WHEN THE FOCUS IS ON THE 
AMOUNT OF LEARNING OR NUMBER OF TA.^KS COMPLETED. 

<b) A FEW CAUTIONS ABOUT THE STRAIGHTFORWARD 
REPORTING OF RAW SCORES NEED TO BE NOTED. 

- A STUDENT'S SCORE IS NOT ANCHORED OR RELATED 
TO THE AVERAGE JR VARIATION OF SCORES EARNED 
BY OTHER STUDENTS. 

- WHEN STUDENTS HAVE DIFFERENT OPPORTUNITIES 
TO RESPOND, COHPARISONS ON NUMBER CORRECT 
OR INCORRECT CANNOT BE MADE. 

- RAW SCORES DO NOT ALWAYS REFLECT THE NUMBER 
OF "OPPORTUNITY TO RESPOND*. 

11.4.3 USING RATE. 

im) R.iTE Ok F^^EOUENCY OF PERFORMANCE IS ONE OF THE 

HOST PREFERABLE SCORES FOR REPORTING PERFORMANCE. 

(b) RAT2 SCORES HAVE THE THE FOLLOWING ADVANTAGES: 

- THEY MAY DISi:RI^<INATE DIFFERENT PROFICIENCY 
LEVELS, I.E., HOW FAST OR FLUENT A STUDENT IS 
PERFORMIM^, THAT ARE NOT VISIBLE WITH ACCURACY 
ALONE. 
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THEY ENSURE COHPARABILITY OF DATA BY 
CONTROLLING FOR THE 'OPPORTUNITY TO RESPOND. 



12. 0 VNAT SKILLS TO ASSESS 

12.1 INTRODUCTION 

12.1.1 IN THE PREVIOUS PART OF THIS HODULE THE FOCUS WAS ON THE 
ASSESSMENT OF ACADEMIC SKILLS. 

(«) THE DISCUSSION CENTERED ON ARRANGING MATERIALS AID 

SETTINGS IN A MANNER THAT ALLOWED THE STUDENT TO SHOW 
CERTAIN ACADEMIC PERFORMANCE. .. AND, IN TURN, ALLOW 
TEACHERS TO >?VALUATE STUDENT LEARNING AND INSTRUCTIONAL 
EFFECTIVENESS. 

12.1.2 MANY OF THE GENERAL PRINCIPLES AND GUIDELINES DISCUSSED IN THAT 
SECTION MAY BE APPLIED TO THE ASSESSMENT OF SOCIAL SKILLS. 

(•) INCLUDING TIME IN ASSESSMENTS* 

(b) ANALYZING 'OPPORTUNITIES TO RESPOND' 

(C> INSURING MEASUREMENT OF RELIABILITY AND VALIDITY 

(d) ETC. 

12.1.3 A MAJOR DIFFERENCE OF THIS PART OF ThE MODULE WILL BE 
A FCCUS ON THE DIRECT OBSERVATION OF SOCIAL BEHAVIORS 
WITHIN THE CONTEXT OF 'NATURAL' SETTING CONDITIONS. 

<■) WE WILL LOOK AT SOCIAL SKILLS WITHIN THE CONTEXT OF 
THE ANTECEDENTS AND COHSEQt ^NCeS OF THE SETTING IN 
WHICH THEY OCCUR. 

(b) BEHAVIORS DJ NOT OCCUR IN A VACUUM. .. AND THE TERM 

'SOCIAL SK4LL' USUALLY MF.ANS THAT THE BEHAVIORS ARE 
GCCURRINC WITHIN SOME KIND OF SOCIAL CONTEXT. 

12.1.4 ANOTHER DIFFERENCE fiLL BE A FOCUS ON INTERPERSONAL, SCHOOL 
FAMILY, AND COMMUNITY BEHAVIORS. 



12.2 



TO START, WE NEED TO LOOK AT SOCIAL BEHAVIORS IN AN OBJECTIVE 
AND POSITIVE MANNFrt, I.E.» WE MUST WORK ON REMOVING OUR OWN 
BIASES AND STEREOTYPES. 
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12.2.1 ONE WAY THAT THIS CAN BE ACCOMPLISHED IS BY EXAMINING 
SOCIAL BEHAVIORS WITH RESPECT TO THEIR FREQUENCY OF 
OCCURRENCE AND TO THE SETTING IN ' ICH THEY OCCUR. 

12.2.2 A SIMPLE THREE PART CATEGORIZATION FORMAT MIGHT bE 
CONSIDERED. (DISPLAY T-12.2. 2) 

(1) BEHAVIORAL EXCESSES ARE THOSE SOCIAL BEHAVIORS 
THAT A STUDENT EXHIBITS THAT OCCUR TOO MUCH OR 
OFTEN. 

- THESE EXCESSES COULD BE BEHAVIORS THAT NEED 

TC BE ELIMINATED FROM THE STUDENT'S BEHAVIORAL 
REPERTOIRE, SUCH AS, HITTING OTHERS, THROWING 
OBJECTS, ETC. 

- THESE EXCESSES COULD ALSO BE BEHAVIORS THAT 
kR2 ACCEPTABLE IN THEIR BASIC FORM BUT ARE 
UNACCEPTABLE AT THEIR PRESENT RATES, FOR 
EXAMPLE, TALKING EXCESSIVELY, RAISING HAND TOO 
OPTEN, DRIVING TOO FAST, ETC. 

(b) BEHAVIORAL DEFICITS ARE ANALOGOUS TO EXCESSES 
£XCEPT ikAT THESE ARE BEHAVIORS THAT OCCUR AT 
LEVELS THAT ARE TOO INFREQUENT. . . A'4D GENERALLY 
NEED TO BE IMPROVED. 

<c) BEHAVIORAL ASSESTS ARE BEHAVIORS THAT A STUDENT 
CURRENTLY POSSESSES THAT ARE FUNCTIONALLY AND 
SOCIALLY USEFUL TO THEM. 

' THESE ARE IMPORTANT BEHAVIORS TO ASSESS 
BECAUSE THEY MIGHT FUNCTION AS ACCEPTABLE 
BEHAVIORS THAT COULD BE TAUGHT TO REPLACE 
UNDESIRABLE ONES AND BECAUSE THEY HELP 
TEACHERS AND OTHERS SEE THE STUDENT AS A 
PERSON WITH STRENGTHS. 

12.2.3 TEACHERS CAN REMAIN MORE OBJECTIVE AND POSITIVE BY 
DEFINING WHAT SOCIAL BEH*/IORS THEY ARE ASSESSING OR 
TEACHING IN 'OPERATIONAL- OR OBSERVABLE TERMS 

(a) SIMPLY PUT, THIS MEANS DESCRIBING WHAT IS BEING 
ASSESSED IN TERMS THAT ANOTHER PERSON CAN 
RELIABLY IDENTIFY THE PRESE'/CE OF THAI BEHAVIOR. 
FOR EXAMPLE, 'GETTING ALONG WITH OTHERS IS NOT 
AN OPERATIONAL DEFINITION BECAUSE IT COIILD USED 
TO LABEL A WIDE VARIETY OF SOCIAL SKILL BEHAVIORS. 

AN OPERATIONAL DEFINITION FOR THIS GENERAL AREA 
MIGHT iE 'TALKING WITH TWO PEERS FOR AT LEAST 
15 MINUTES' OR 'USING THE COMPUTER FOR EQU/|i 
AMOUNTS OF TIME WHEN WORKING ON MATH PROBLbni 
WITH ONE OTHER PEER. ' 
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12.2.1 A THIRD STRATEGY FOR REMAINING OPJECTIVE DURING THi. 

ASSESSHCNT OF SOCIAL BEHAVIORS IS TO APPLY THE 'FAIR 
PAIR PRINCIPLE. " 

(•) LIKE FOCUSING ON BEHAVIORAL ASSETS, THE *FAIR 
PAIR PRINCIPLE* EMPHASIZES THE IDENTIFICATION 
AND ASSESSMENT OF BEHAVIORS THAT WILL TAKE THE 
PLACE OF OR REPUCE BEHAVIORS THAT NEED TO BE 
ELIMINATED. 

(b) IT IS IMPORTANT Ti^ Kw£P IN MIND THAT THE INITIAL 
AND CONTINUED ELIMidlAVION OR REDUCTION OF 
BEHAVIORAL EXCESSES MILL BE FACILITATED IF A 
BEHAVIOR CAN BE IDENTIFIED TO REPLACE THE EXCESS 
AND IF THAT BEHAVIOR WILL RESULT :N POSITIVE 
REINFORCEMENT FOR THE STUDENT. 

(c) WE CAN'T EXPECT A BEHAVIOR TO BE REMOVED IF THE 
STUDENT DOES NOT HAVE A BEHAVIOR TO REPLACE IT. 

- IT IS SOMETIMES USEFUL TO THINK OF BEHAVIORS 
AS BEING COMMUNICATIVE. IF A STUDENT ONLY HAS 
ONE WAY TO COMMUNICATE (I.E., SET THE OCCASION 
FOR REINFORCEME^iT), S/HE WILL CONTINUE TO USE 
THAT BEHAVIOR... EVEN IF IT IS SOCIALLY UNDESIRABLE. 

12.2.3 A FINAL GUIDE TO HELP US REMAIN POSITIVE AND OBJECTIVE 
IN OUR ASSESSMENTS OF SOCIAL BEHAVIORS IS TO FOCUS ON 
SOCIALLY DESIREABLE BEHAVIORS. 

(«) THIS STATEMENT IMPLIES THAT WE NEED TO ASSESS AND 
TEACH BEHAVIJRS THAT ARE OF FUNCTIONAL USE TO THE 
STUDENT IF THEY ARE INCREASED, DECREASED, AND/OR 
MAINTAINED. 

(b) WE NEED TO INSURE THAT THE BEHAVIORS WE ASSESS TO 
BE TAUGHT OR REINFORCED WILL CAUSE THE STUDENT TO 
BE PERCEIVED MORE FAVORABLY IN THE SOCIAL 
ENVIRONMENT AND TO BE MORE LIKELY TO BE REINFORCED 
BY RELEVANT OTHERS. 

SO, WHAT SOCIAL SKILL CAN WE ASSESS? 

12.3.1 THE ANSWER IS SIMPLY ANYTHING THAT CAN BE MEASURED. 

12.3.2 RATHER THAN CATEGORIZING TH.. MANY BEHAVIORS THAT CAN 
BE ASSESSED, IN THIS SECTION WE WILL DISCUSS THE 
CHARACTERISTICS OF THOSE SKILLS THAT C 4N BE ASSESSED, 
CHANGED, OR TAUGHT AND THE SETTING IN 'HICH THOSE 
BEHAVIORS ARE OBSERVED. THERE ARE SIX SIMPLE 
COMPONENTS TO BE ASSESSED. (DISPLAY T-i2.3.2) 

(•) SETTING - THE PLACE OR CONDITIONS UNDER WHICH A 
SOCIAL SKILL IS OBSERVED OR EXPECTED TO OCCUR. 
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- FOR EXAMPLE, A TEACHER MIGHT BE INTERESTED IN 
ASSESSING HER/HIS STUD':NTS' ABILITY TO ASK FOR 
MATERIALS IN A SOCIALLY APPROPRIATE HANNCR, 

E.G., 'PLEASE, MAY I BORROW * THE SETTING 

CONDITIONS NIGHT BE DURING A GROUP SCIENCE 
ACTIVITY, AT THE CASH F.EGISTER OF A STORE, OR 
IN THE INDUSTRIAL ARTS AREA. THIS BEHAVIOR IS 
APPROPRIATE ACROSS A NUMBER OF SETTINGS, 
WHEREAS, RAISING HAND MAY BE FUNCTIONALLY 
APPROPRIATE ONLY DURING LARGE GROUP DISCUSSIONS 
AT SCHOOL OR OTHER SIMILAR SETTINGS. 

(b) PRC-DISPOSING FACTORS ' THOSE SKILLS, 
CHARACTERISTICS, OR CONylTIOHS TH«T ARE 
ASSOCIATED WITH A SPECIFIC STUDENT AND THAT 
AFFECT HIS/HER ABILITY TO CHANGE OR LEARN A 
SOCIAL SKILL. OFTEN TIMES WE LOOK AT A 'STUDENT'S 
PRIOR LEARNING HISTORY TO HELP US IDENTIFY 
CONTRIBUTING INFLUENCES. 

- FOR EXAMPLE, BEING ABLE TO LEARN HOW TO SAY 
"PLEASE, MAY I BORROW. . . * MAY BE AFFECl a 
STUDENT'S KNOWLEDGE ABOUT BORROWING, OR h/S/HER 
ABILITY TO IDENTIFY (LEARNING HISTORY) WHEH 

TO USE THAT TYPE OF STATEMENT. 

(c) PRECIPITATING OR TRIGGERING FACTORS « THOSE 
THINGS OR EVENTS THAT SIGNAL OR INDICATE VO A 
STUDENT TO ENGAGE IN 4 GIVEN SOCIAL BEHAVIOR. 
THESE TRIGGERING FACTORS FOR MOST STUDENTS SIGNAL 
SOME KIND OF SOCIALLY APPROPRIATE ADAPTIVE 
RESPONSE, WHEREAS, THESE SAHk* FACTORS MAY TRIGGER 
MALADAPTIVE BEHAVIORS FROM OTHER STUDENTS. 

- FOR EXAMPLE, WHEN HE IS OUT OF PAPER, GORDIE 

;?ESPONDS BY SAYING "PLEASE, MAY I BORROW * 

BUT, KAY, ON THE OTHER HAND, WILL GRAB PAPER 
FROM A NEIGHBOR WHCK SHE NEEDS ANOTHER PIECE. 

(ii' CONTRIBUTING FACTORS « THOSE THINGS OR EVENTS 
THAT FOLLOW A STUDENT'S ACTIONS THAT SERVE TO 
INCREASE OR DECREASE IT. AGAIN, THESE 
CONTRIBUTING FACTORS MAY BE ASSOCIATED WITH 
ADAPTIVE AS WELL AS MALADAPTIVE BEHAVIORS. 

- FOR EXAMPLE, GORDIE SAYS 'PLEASE, MAY I 
BORROW.,..' BECAUSE MANY STUDENTS AND ADULTS 
WILL HAND LOAN HIM WHAT I'E WANTS AND WILL SAY 
SOMETHING POSITIVE IN RETURN. KAY GRABS ITEMS 
BECAUSE SHE ALSO GETS WHAT SHE WANTS. .. AND SHE 
MANAGES TO GET SOME KIND OF REACTION OR 
ATTENTION FROM THE PERSON SHE HAS GRABB^'O FROM. 

(•) TIME REFERS TO WHEN, HOW LONO, OR HOW FAST A 
GIVEN SOCIAL BEHAVIOR lb HPl^ERVED. 
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- F08 eXAHPLC, HIKE SAYS "PLEASE, HAY I 
BORROW..." BUT HE SAYS IT AFTER HE HAS ALREADY 
GRABBED IT FROH HIS NEIGHBOR. DAVE HAS A 
SIHILAR TIHING PROBLEM IN THAT HE SAYS THE 
PHRASE APPROXIHATELY 12 TIHES AN HOUR. IN HIS 
CASEp THE SOCIAL SKILL IS ACCURATE. . . BUT IT 
OCCURS TOO NUCH. 

<f) SOCIAL BEHAVIOR > THE ACTUAL BEHAVIOR TO BE 
CHANOCO OR TAUGHT. FOR THE PURPOSES OF THIS 
MODULE, A SOCIAL BEHAVIOR CAN BE AN APPROPRIATE 
SOCIAL SKILL OR AN INAPPROPRIATE BEHAVIOR THAT 
NEEDS TO BE ELIMINATED. IT FUNCTIONS AS A HEANS 
OF MOVING EFFECTIVELY THROUGH THE SOCIAL ENVIRONMENT. 

* FOR EXAMPLE, SAYING "PLEASE, MAY I BORROW..." 

IS THE SOCIAL BEHAVIOR. WE'VE ALREADY SHOWN 12.4 
HOW IT CAN BE APPROPRIATE AND INAPPROPRIATE. 
"GRABBING" IS ALSO A SOCIAL BEHAVIOR THAT WE 
MIGHT NEED TO ASSESS. 

12.3.3 LETS LOOK AT SOCIAL BEHAVIORS IN MORE DETAIL... 
SPECIFICALLY, WE WILL DISCUSS IHR DIFFERENT 
DIM2NSI0NS THAT A BEHAVIOR MIGHT TAKE AND THAT WE 
HIGHT FOCUS OUR ASSESSMENT ON. A BEHAVIOR MANY HAVE 
SIX DIFFERENT DIMENSIONS. (DISPLAY T-12.3.3) 

(■) TOPOGRAPHY REFERS TO THE SHAPE OR CHARACTERISTICS 
THAT A BEHAVIOR HAS. 

- FOR EXAMPLE, SHAKING HANDS HAS A VARIETY OF 
TOPOGRAPHIES: A PORMAL^ BUSIHESS^RELATED 
SHAKE} A HIGH^FIVE SHAKE; A "BROTHERS" 
HANDSHAKEi ETC. 

(b) DURATION REFERS TO HOW LONG A BEHAVIOR LASTS 

- FOR EXAMPLE, DOES THE HANDSHAKE LAST FOR AN 
APPROPRIATE LENGTH OF TIME OF ABOUT 2-3 
SECONDS, OR DOES IT LAST FOR 10 SECONDS? 

(c) LATENCY REFERS TO HOW LONG IT TAKES FOR THE 
BEHAVIOR TO BE INITIATED AFTER AN APPROPRIATE 
TRIGGERING EVENT HAS OCCURRED. 

- FOR EXAMPLE, AFTER MR. NELSON SAYS "HLLLO, 
NICE TO MEET YOU, " DOES ROB SHAKE HANDS 
WITHIN 2 SECONDS OR DOES HE WAIT UNTIL THE 
INITIAL GREETINGS ARE CONCLUDED AND THE TOPIC 
HAS CHANGED. 



IS FIRM AND STEADY. THE "DEAD-FISH" GRIP OR 
THE 'IRON-MAN" CLAMP ARE GENERALLY PERCEIVED 
AS SOCIALLY UNACCEPTABLE. 

(e) LOCUS REFERS TU WHERE THE BEHAVIOR OCCURS. 

- FOR EXAMPLE, MARK HAS A GOOD STURDY HANDSHAKE 
BUT HE ONLY USES IT WHEN HE KNOWS THE OTHER 
PERSON AND WHEN HE IS AT HOME. 

if) FREQUENCY REFERS TO HOW OFTEN OR HOW FAST THE 
BEHAVIOR OCCURS. 

- FOR EXAMPLE, RON LIKES TO SHAUE HANDS AND 
WILL SOMETIMES SHAKEHANDS lS-20 TIMES A DAY, 

WHAT WE ASSESS CAN COVER A BROAD RANGE OF SOCIAL SKILLS AND 
BEHAVIORS. RATHER THAN CATEGORIZING THESE BEHAVIORS, WE HAVE 
DISCUSSED SOHE GENERAL GUIDELINES THAT MIGHT HELP US IDENTIFY 
WHAT TO ASSESS IN Am OBJECTIVE AND SYSTEMATIC HANNER. 

12.4.1 WE IDENTIFY SIX CRITICAL SOCIAL SKILL COMPONENTS THAT 
SHOULD BE ASSESSED. 

<■) SETTING IN WHICH THE BEHAVIOR OCCURS OR DOESN'T OCCUR. 

<b) PREDISPOSING FACTORS THAT THE STUbCNT BRINGS TO 
THE SETTING. 

<c) PRECIPITATING OR TRIGGERING FACTORS THAT SET UP 

THE OCCASION FOR A GIVEN SOCIAL BEHAVIOR TO OCCUR. 

(d) CONTRIBUTING FACTORS THAT TEND TO FOLLOW A 

BEHAVIUR AND ARE ASSOCIATED WITH AN INCREASE OR 
DECREASE IN THE BEHAVIOR. 

<•) TIME, OR WHEN AND HOW LONG A BEHAVIOR OCCURS. 

if) SOCIAL BEHAVIOR. 

12.4.2 WHEN WE LOOK MORE CLOSELY AT THE SOCIAL BEHAVIOR ITSELF, 
WE SEE THAT IT MAY BE DESCRIBED AND ASSESSED ALONG ONE OR 
nORE DIMENSIONS. 

<■) FREQUENCY 

(b) TOPOGRAPHY 

(c) LOCUS 

(d) INTENSITY 
(•) DURATION 

( i ) LATENCY 



<d) INTENSITY REFERS TO THE AMOUNT C ' FORCE A GIVEN 
SOCIAL BEHAVIOR MIGHT BE CHARACTERIZED WITH. 
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FOR EXAMPLE, A SOCIALLY ACCEPTABLE HANDSHAKE 



13.0 HOW TO ASSESS SOCIAL SKILLS 

13.1 FOLLOWING THE FOCUS OF THE PREVIOUS SECTION, WE WILL DISCUSS 
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HOW TO ASSESS SOCIAL SKILLS FROM A GENERIC APPROACH. 

13.1.i WE WILL EMPHASIZE PKOCEDORES AMD G^I^^^LIMES TH^ 

SHOULD BE APPLICABLE ACROSS A WIDE VARIETY OF SOCIAL 
SKILLS AMD BEHAVIORS. 

(■) THESE PROCEDURES AMD OUIDELIMES SHOULD ALSO BE 
USEFUL IM ADAPTING COMMERCIALLY PREPARED 
ASSESSMENT DEVICES TO YOUR INDIVIDUAL ASSESSMENT 
PURPOSES. 

13 1 2 FOLLOWING THE DIRECT INTERVENTIONIST APPROACH THAT 
SERVES AS A FOUNDATION FOR OUR WORK IN SPECIAL 
EDUCATION. WE WILL CONTINUE TO FOCUS ON OBSERVABLE 
BEHAVIORS. 

13.2 FIRST A REMINDER OF SOME BASICS. 

13 2 1 WE ALREADY MENTIONED THAT WE WILL FOCUS ON OBSERVABLE 
BEHAVIORS. BUT THIS IS ALSO RELATED TO BEING 
PERFORMANCED-BASED. 

(•) WE WANT TO SEE SOCIAL KILLS IN ACTION... SO WE 

MUST ASSESS SOCIAL SKILL ACTION RATHER THAN PROMISES. 

13 2 2 AS DISCUSSED IN PART 1 OF THIS MODULE, WE WILL ASSESS 
SOCIAL SKILLS IN A FORMATIVE FASHION. 

(•) TO GET THE BEST MEASURE OF SOCIAL SKILL 

ACQUISITION AND MAINTENANCE. WE SHOULD ASSESS 
REGULARLY OVER TIME RATHER THAN AT THE BEGINNING 
AND END OF AN INSTRUCTIONAL TIME PERIOD. 

13.2.3 WE SAID THAT THERE ARE FOUR BASIC LEVELS OF ASSESSMENT. 

<■) ARCHIVAL RECORDS 

(b) VERBAL REPORTS 

(c) TESTS 

(d) DIRECT OBSERVATION 

13 2.4 IN THE ASSESMENT OF SOCIAL SKILLS. WE ^ILL FOCUS ON 
THE USE OF DIRECT OBSERVATION PROCEDUf £S. 



14.0 INDIRECT OBSERVATION STRATEGIES 

14.1 THERE ARE NUMBER OF WAYS TO ASSESS SOCIAL SKILLS WITHOUT 
DIRECTLY OBSERVING THE SOCIAL BEHAVIOR. 

14.1.1 ANECDOTAL REPORTS CAN TAKE TWO BASIC FORMS. 

(•) WE CAN OBTAIN INFORMATION ABOl»T A STUDENT'S SOCIAL 
SKILLS FROM WRITTEN RECORDS. THESE WRITTEN 
RECORDS REPRESENT A PERSON'S INTERPRETATION AND 
DESCRIPTION OF A STUDENT'S SOCIAL SKILLS; 
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HOWEVER. THE READER SHOULD BE CAREFUL ABOUT THE 
MEANING DERIVED FROM SUCH REPORTS. 

- A READER'S INTERPRETATION IS BASED ON THE 
WRITER'S INTERPRETATION OF THE STUDENT'S 
BEHAVIOR... SO THE READER IS DEVELOPING 
SECONDHAND IMPRESSIONS. 

- SOME WRITTEN REPORTS ARE BASED ON INTERVIEWS 
WITH OTHER RELEVANT INDIVIDUALS IN THE 
STUDENT'S LIFE WHICH DILUTES THE VALIDITY 
EVEN FURTHER. 

- AN AUTHOR'S WRITTEN IMPRESSIONS HAVE SELF- 
FULFIUING EFFECTS AND MAY CAUSE THE READER TO 
INFER MORE THAN IS ACCURATE. 

- FOR EXAMPLE, WHEN MR. NELSON READ ABOUT 
GEORGE'S 'AGGRESSIVE BEHAVIOR." HE ASSUMED 
THAT GEORGE WAS PHYSICALLY AGGRESSIVE, I.E., 
HIT OTHERS AND DESTROYED PROPERTY. HOWEVER. 
GEORGE IS ACTUAUY ONLY VERBALLY AGGRESSIVE. 
I.E.. HE TALKS-BACK AND TENDS TO CALL PEOPLE 
DEROGATORY NAMES. 

' WRITTEN REPORTS ARE FREQUENTLY BASED ON A 
STUDENT'S PRIOR BEHAVIORAL HISTORY, AND MAY OR 
MAY NOT REFLECT THE STUDENT'S CURRENT SOCIAL 
SKILL LEVELS. 

<b) ANECDOTAL REPORTS MAY ALSO BE OBTAINED THROUGH 
STRUCTURED AND UNSTRUCTURED VERBAL INTERACTION. 
LIKE WRITTEN REPORTS THESE INDIRECT ASSESSMENTS 
PROVIDE INFORMATION ABOUT A STUDENT'S SOCIAL 
SKILLS THROUGH ANOTHER PERSON'S INTERPRETATIONS 
AND DESCRIPTIONS. SIMILAR USE PRECAUTIONS APPLY. 
IN ADDITION. 

- VERBAL REPORTS ARE FREQUENTLY SHAPED OR 
INFLUENCED BY THE INTERACTION BETWEEN THE 
PEOPLE DISCUSSING THE STUDENT. FOR EXAMPLE. A 
PERSON'S SOCIAL OR PROFESSIONAL STATUS MAY 
CAUSE THE SPEAKER TO EMBELLISH A DESCRIPTION 
TO HEET THEIR EXPECTATIONS ABOUT THE LISTENER. 

4.1.2 CHECKLISTS. INVENTORIES. AND RATING SCALES ARE OTHER 
COMMONLY USED FORMATS FOR ASSESSING SOCIAL BEHAVIORS. 

U) THESE ASSESSMENT DEVICES HAVE THE FOLLOWING 

CHARACTERISTICS: 

- USUALLY A FIRST STEP IN ASSESSING SOCIAL SKILLS 
AND BEHAVIORS. 
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- FREQUENTLY USED TO IDENTIFY SOCIAL SKILL 
PROBLEMS RATHER THAN STRENGTHS. 

- ALSO CFTEN USED TO IDENTIFY FEELINGS AND 
ATTITUDES AS WELLS AS PERSONALITY 
CHARACTERISTICS, E.G., SELF-CONCEPT, SELF-ESTEEH. 

- GENERALLY FILLED OUT BY SOHEONE WHO HAS 
OBSERVED THE STUDENT OVER TIHE AND KNOWS THE 
STUDENT WELL. 

- PARENT, TEACHER, PEER, OR STUDENT 

- BEHAVIORAL STATEMENTS OR DESCRIPTIONS ARE 
PRESENTED AND THE RATER HUST JUDGE TO WHAT 
DEGREE THE STATEMENT DESCRIBES THE STUDENT. 

- BASED ON OPINION RATHER THAN DIRECT MEASURES. 

(b) A NUHBER OF WEAKNESSES ARE ASSOCIATED WITH 
CHECKLISTS AND RATINGS SCALES THAT AFFECT THEIR 
RELIABILITY AND VALIDITY. 

- ASSESSMENT OUTCOMES ARE SUBJECTIVELY BASED AND 
DEPENDENT UPON THE RATERS OBSERVATION SKILLS, 
MEMORY, AND ABILITY TO JUDGE OR RATE BEHAVIOR. 

- TEND TO EMPHASIZE THE ASSESSMENT OF 
INAPPROPRIATE BEHAVIORS. 

• FREQUENTLY ASSUMED TO MEASURE 'HYPOTHETICAL 
CONSTRUCTS" (I.E., NON-SPECIFIC PERSONALITY 
STATES THAT ARE ASSUMED TO EXIST THOUGH NOT 
DIRECTLY OBSERVABLE). 

- BECAUSE THEY TEND TO BE GENERAL SCREENING 
DEVICES WITH A LIMITED SAMPLE OF RESPOHSE 
CHOICES, THEY MAY NOT ACCURATELY REFLECT THE 
SPECIFIC BEHAVIORAL STRENGTHS AND WEAKNESSES 
OF A STUDENT. 

14. 

* TEND NOT TO BE DIRECTLY TRANSLATABLE INTO 
EDUCATIONAL ^PROGRAMMING. USUALLY REQUIRES 
ADDITIONAL IN-DEPTH ASSESSMENT AND EVALUATION. 

- HOST RATING SCALES AND CHECKLISTS HAVE SEEN 
DEVELOPED AND VALIDATED FOR ELEMENTARY AGE 
STUDENTS. THERE ARE FEW THAT ARE DIRECTLY 
APPLICABLE rO THE ADOLESCENT AND YOUNG ADULT. 

(c) SOME COMMONLY USED CHECKLISTS THAT HAVE BEFN 
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- DESIGNED TO BE USED BY PARENTS FOR STUDENTS 
AGED 13- Id. 

- 12 CATEGORIES (E.G., "UNETHICAL BEHAVIOR," 
"EMOTIONAL DISTANCE, ' "PHYSICAL INFERIORITY- 
TIMIDITY". 

- MCQNEY PROBLEM CHECK LISTS (MOONEY CORDON, 1950) 

- GRADES 7-12 AND COLLEGE (NOT NORM-REFERENCED) 

- COMPLETED BY STUDENTS 

- HIGH SCHOOL VERSION HAS 11 AREAS (E.G., 
FINANCES, LIVING CONDITIONS AND EMPLOYMENT; 
SOCIAL AND RECREATIONAL ACTIVITIES; AHD 
COURTSHIP, SEX AND MARRIAGE). 

- OTHERS 

- A PROCESS FOR IN-SCHOOL SCREENING OF 
CHILDREN WITH EMOTIONAL HANDICAPS (BOWER & 
LAMBERT, 1962). 

- PUPIL BEHi.VIOR INVENTORY (VINTER, SARRI, 
VORWALLER, & SCHAFER. 1966). 

- HAHNEMANN HIGH SCHOOL BEHAVIOR RATING SCALE 
(SWIFT & SPIVACK, 1973). 

(d) CHECKLISTS AND RATING SCALES SHOULD BE USED IF 

- A GENERAL SCREENING IS DESIRED 

- IF DIRECT MEASUREMENT PROCEDURES CANNOT BE 
IMPLEMEMTEH 

- IF SUBJECTIVE INTERPRETATIONS CAN BE 
TOLERATED. 

1.3 SOCIOGRAMS AND OTHER SIMILAR PROCEDURES ARE SOMETIMES 
USED TO ASSESS SOCIAL SKILLS. 

(■) IN GENERAL, THESE PROCEDURES REQUIRE STUDENTS 
TO RATE THEMSELVES ALONG A SINGLE CRITERION OR 
CONTINUUM OF DESCRIPTORS IN KELATIONSHIP TO THEIR 
PEERS OR SOCIAL ENVIRONMENT. 

(b) INTENDED PURPOSES: 

- TO TOENTIFY WORK HABITS 



- 10 DETERMINE RELATIVE POPULARITY/UNPOPULARITY, 
ACCEPTANCE/REJECTION, IMPULSIVITY/COMPULSIVITY, 
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COOPERATIOM/NOIi'COHPLlANCE 

- TO IDENTIFY LEVEL OF SELF-CONCEPT OR SELF- 
ESTCEH* SELF-IHAGE 

- TO IDENTIFY FEELINGS/ATTITUDE TOWARD SCHOOL, 
KOHE. rOHHUNITY, SCHOOL, ETC. 

(C) SOCIOGRAHS GENERALLY ASK THE STUDENT TO 

- NAHE OTHER STUDENTS WHO BEST HATCH SOHE 
DESCRIPTOR 

- EXAMPLE, NAHE THREE STUDENTS WHO ARE GOOD 
STUDENTS. 

- RANK ORDER THEHSELVt^": AND/OR STUDENTS 

- HOST TO LEAST POPULAR 
<d) CAUTIOHS 

- CONFIDENTIALITY HUST BE MAINTAINED 

- RATINGS ARE SUBJECTIVELY BUSED AND EVALUATED 

HOT TRANSLA E IN TEACHABLE OBJECTIVES 

14.2 THE ABOVE INDIRECT STRATEGIES FOR ASSESSING SOCIAL SKILLS 

AND BEHAVIORS CAN BE USEFULi HOWEVER, A CLEAR UNDERSTANDING 
OF THEIR LIMITATIONS AND PURPOSE IS NECESSARY. 

14.2.1 THEIR USE TENDS TO BE LIMITED IT THE GENERAL 
SCREENING OF STUDENT SOCIAL SKILkS ?0 THAT RELATIVE 
RELATIVE RATINGS OR COMPARISONS CAN lE MADE. 

14.2.2 BECAUSE THEY ARE INDIRECT MEASURES, IHIY ARE 
CHARACTERIZED BY SUBJECTIVE IN'i'ERPR NATION. 



15.0 DIRECT ASSES&. STRATEGICS OF SCCIaL SKILLS 

15.1 IN THIS SECTION OF THE MODULE WE WILL DISCUSS BASIC STRATEGIES 
FOR ASSESSING SOCIAL SKILLS THROUGH THE USE OF DIRECT OBSERVATION 
PROCEDURES. 

15. 1.1 WE WILL FOCUS ON THE SIMPLE AND COMMONLY USED 
ASSESSMENT PROCEDURE CALLED A FUNCTIONAL ANALYSIS. 

15. 1.2 AS A REMINDER, THE EFFECTIVE AND RELIABLE USE OF 
DIRECT OBSERVATION SYSTEMS IS DEPENDENT UPON: 

(•) A CLEAR AND OPERATIONAL DEFINITION OF WM'^ 
SOCIAL SKIIL IS BEING ASSESSED. 




ASSbSSMbHi UF tXChPiiUNAL iriUlVlUUAl 



<b) FORMATIVE EVALUATION 

<c) AN UNDERSTANDING OF THE DIRECT RELATIONSHIP 

BETWEEN THE SOCIAL BEHAVIOR AND THE SETTING OR 
ENVIRONMENTAL CONDITIONS. 

IS. 1.3 "DIRECT" REFERS 70 ASSESSING A SOCIAL BEHAVIOR AS IT 
IS OCCURRING. 

(■) UNLIKE PREVIOUSLY MENTIONED PROCEDURES SUBJECTIVE 
INTERPRETATIONS AND JUDGEMENTS ARE REDUCED. 

<b) OBJECTIVE AND DESCRIPTIVE DATA ARE PROVIDED; 

THUS, REDUCING THE NEED TO INFER SOME UNDERLYING, 
UNOBSERVABLE HYPOTHETICAL CONSTRUCT. .. THAT MAY 
NOT BE DIRECTLY MANIPULATABLE. 

S.2 FUNCTIONAL ANALYSIS AND FUNCTIONAL RELATIONSHIPS 

15. 2.1 A FUNCTIONAL ANALYSIS IS A PROCEDURE FOR DIRECTLY 
OBSERVING A STUDENT'S BEHAVIOR AND THE SETTING 
CONDITIONS ASSOCIATED WITH THE BEHAVIORS. 

(a) IT IS TEMPORALLY OR TIME-BASED, THAT IS, SOCIAL 
BEHAVIOR EVENTS ARE ASSESSED AND EVALUATED 
WITHIN AND ACROSS TIME. 

(b) IT CONSISTS OF FOUR MAJOR COMPONENTS. 

- THE STUDENT'S SOCIAL BEHAVIOR 

' ANTECEDENT OR PRECEDING EVENTS TO THE BEHAVIOR 

- CONSEQUENCE OR FOLLOWING EVENTS TO THE BEHAVIOR 

- AND TIME. 

(c) OUTCOMES FROM A FUNCTIONAL ANALYSIS ARE TESTABLE 
STATEMENTS ABOUT A STUDENT'S BEHAVIOR AND FACTORS 
EXISTING IN TH^ SETTING. 

- CAUSE-EFFECT RELATIONSHIPS CAN BE DEVELOPED 

- PREDICTABLE BEHAVIORAL CHAINS CAN BE IDENTIFIED 

15. 2. 2 CONDUCTING A FUNCTIONAL ANALYSIS IS ACCOMPLISHED BY 
OBSERVING THE SEQUENCE OF EVENTS AND BEHAVIORS THAT 
ARE ASSOCIATED WITH A STUDENT'S BEHAVIORS. A SIMPLE 
FORMAT CAN BE USED. (DISPLAY IS.2.2) 
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(•) DIRECTIONS 

' THE OBSERVER SHOULD NOTE THE TIME ON AT LEAST 
FIVE ll~':UTE INTERVALS TO GET SOME ESTIMATE OF 
THE DISTRIBUTION OF THE STUDENT'S BEHAVIORS 
OVER TIHE. 

- BRIEFLY DESCRIBE EACH STUDENT BEHAVIOR IN THE 
"BEHAVIOR" COLUHN. 

- BRIEFLY dCSCRIBE EACH ANTECEDENT OR CONSEOUENCF 
THAT IS CONIINOeNTLY OR DIRECTLY ASSOCIATED 
WITH A BEHAVIOR. 

- IF A CONSEQUENCE ALSO FUNCTIONS AS AN 
ANTECEDENT FOR THE NEXT BEHAVIOR, INDICATE WITH 
A CHECK ( ) OR A *C" IN THE ANTECEDENT COLUKN. 

- BEHAVIORAL CHAINS ARE THUS INDICATED. 

{b) ILLUSTRATION (DISPLAY T-lS.2.2a AND T-15.2.2b) 

TARGET STUDENT « JIH 

SETTING > HATH CLASS; STUDENT'S ENGAGED IN 
INDIVIDUAL SEATWORK... QUIETLY. HR. RUTHERFORD 
IS r^RADING HIS PAPERS AND ANSWERING A FACULTY 
HEHl. ABOUT THE STAFF POTLUCK DINNER ON FRIDAY 
^f"" JitNOON. 

OBSERVATION EVENT:. « JIN IS SITTING AT HIS 
DESK WITH THE TASK OF FINISHING HIS HATH 
WORKSHEETS. ELLEN, WHO IS SIHING NEXT TO 
JIH» HAS DECIDED THAT KICKING JIH'S CHAIR 
WOULD BE HORE ENTERTAINING. THE RESULT IS THAT 
JIH BECOHES DISTRACTED AND REACTS BY KICKING 
ELLEN'S CHAIR. HR. RUTHERFORD'S ATTENTION 
IS DIRECTED TO JIH WHC HE VERBALLY REPRIHAND£ 
WITH "DON'T YOU BE KICKING ELLENil" AND WHO 
HZ SENDS TO THE OFFICE TO SEE THE VICE PRINCIPAL. 
JIH STOHPS AND TROHPS OUT OF THE CLASSROOH, 
BUT NOT BEFORE HE WINKS AT ELLEN WHO WINKS BACK. 



CONTENT OUTLINE 



FUNCTIONAL ANALYSIS OBSERVATION PORN 



STUDl ; OBSERVER^ 

TEACHER DATE 



SETTING 



TIKE ANTECEDENTS BEHAVIORS CONSEQUENCES 



STUDENT Jim OBSERVER^,_Hr. N«lson 

TEACHER,. _Hr. Ruthvrford DATE 7/25/85 



SETTING: 9^25 Hath class; lnd«p»nd«nt Matvork; sath vorksh««ts. 
Hr. Ruthffrford sitting at dssk at front of roos. Jls sitting 

next to Ellsn. 



TIHE 

9:27 



ANTECEDENTS 



BEHAVIORS 



CONSEQUENCES 



9:28 



Ellsn kicks 
Jis's chair 



Jls kicks 
Ellsn's chair 



Jls stosps 

1 trorps out 
oi rocs. 



Hr. R. "don't kick 
kick Eilsn. " 
Hr. R. ssnds 
Jis to ths 

office. 



9:29 



Jis vinks 

Ellsn. 



Ellsn vinks back. 
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CON^^r OUfLINE: 



15.2.3 FUNCtlOHAL lELATIONSHIPS ARE DERIVED FROH AN ANALYSIS 
AND TESTING OF INKORHATION FROM A FUNCTIONAL ANALYSIS. 

(•) AN 'F-R.' IS DEFINED AS C STATEMENT DESCRIBING A 
UVFUL OR PREDICTABLE REUTIONSUIP BETWEEN TWO 
VARIABLES, USUALLY THE STUDENT'S "BEHAVIOR AND 
ANTECEDENT OR CONSEQUENCE EVENTS. 

- THE BEHAVIOR OF INTEREST IS CALLED THE 
DEPENDENT VARIABLE. 

- THE AFFECTING VARIABLES (I.E., ANTECEDENTS OR 
CONSEQUENCES) ARE CALLED INDEPENDENT VARIABLES. 

- A FUNCTIONAL RELUIOHSUIP EXISTS WHEN A 
PREOICTABU STATEMENT CAN BE HADE ABOUT THE 
RELATIONSHIP BETWEEN DEPENDENT AND INDEPENDENT 
VARIABLES. , 

(b) FUNCTIONAL RELATIONSHIPS ARE FIRSi DERIVED FROH 
TESTABLE lIXPUNATIONS. 

- A TESTABLE EXPLANATION IS A SPECIFIC STATEMENT 
ABOUT POSSIBLE FUUr*.ONAL RELATIONSHIPS lU 
WHICH OBSERVABLE Ti^eUbEUT AND INDEPENDENT 
VARIABLES ARC ^ UlCnTED. 

- EXAHPLC, 'WHENEVER THE TEACHER HAS A 
TRANSITION BETWEEN LESSONS THAT EXCEED FIVE 
HINUTES, THE NUHBER OF TALKOUTS INCREASES 
THREEFOLD. * 

- E.jiAhPL£, IF ELLEN SITS KEXT TO JIK DURIifC 
.lATH CLASS, JIH DOES HOT FINISH HIS WORK 
AND ^2lL talk with ELLEN." 

(c) A DANGER IS THE CREATION OF E^IPL JATORY FICTIONS. 

AN EXPUNATORY FICTION IS A NON-SPECIFIC 
STATEMENT ABOUT POSSIBLE FUNCTIONAL 
RELATIONSHIPS IN WHICH THE INDEPENDENT OR 
DEPENDENT VARIABLES ARE NOT OBSERVABLE OR 
HANIPUUTABLE. SOMETIMES THE iNr^lPEHDENT 
VARIABLE IS A RESTATEHENT OF THE DEPENDENT 
VARIABLE. 

- EXAMPLE, ■WHENEVER PETER IS HYPERACTIVE* HE 
TALKS BACK AT THE TEACHER. ' BECAUSE 
•HYPERACTIVITY* CAN TAKE SO Ma.MY DIFFERENT 
FORMS, IT IS NOT OBSERVABLE. 

- EXAMPLE, "ELLEN FAILS TO MAKE FRIENDl BECAUSE 
SHE IS EMOTIONALLY DISTURBED.' 

- EXAMPLE, *JIM DOESN'T GET ALONG WITH 

ERIC 
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ADULTS BECAUSE HE IS A JUVENILE DELINQUENT.' 

(d) A TESTABLE EXPLANATION IS A FUNCTIONAL 

RELATIONSHIP 1/ A SYSTEMATIC MANIPULATION OF THE 
INDEPENDENT VARIABLE PRODUCEb A PREDICTABLE 
CHANGE IN THE DEPENDENT VARIABLE. 

- IF AN UNDESIRABLE, UNPREDICTABLE. AND/OR 
NON-ADAPTIVE FUNCTIONAL RELATIONSHIP IS 
IDENTIFIED, THE TEACHER'S TASK IS TO CHANGE 
THE TESTABLE EXPLANATION OR DEVELOP A MORE 
APPROPRIATE ONE. 

- EXAMPLE, IF WE CHANGE ELLEN AND 
GREG'S SEATS SO THAT GREG IS NEXT 
TO JIM, AND IF JIH DOES NOT TALK WITH 
OR TOUCH GREG, THEN OUR TESTABLE 
EXPLANATION STATEMENT ABOUT JIM TrTIKG 
NEXT TO ELLEN IS A FUNCTIONAL RF.LATIONSHIP. 

IF JIM TAUS WITH OR TOUCHES GREG, 
THEN OUR TESTABLE EXPLANATION WILL NEED 
TO BE ADJUSTED SO THAT IT WILL ACCOUNT 
FOR JIM'S BEHAVIORS AND THE SETTING 
CONDITIONS. 

(•) FUNCTIONAL RELATIONSHIP STATEMENTS ARE NOT ONLY 
USEFUL IN ASSESSING SOCIAL SKILL BEHAVIORS BUT 
ALSO IN IDENTIFYING A POSSIBLE PLACE TO START 
INTERVENTIONS OR TEACHING STRATEGIES. 

- WE CAN IDENTIFY WHETHER ACCEPTABLE REPLACEMEHT 
BEHAVIORS EXIST IN THE STUDENT'S 3EHAVI0RAL 
REPERTOIRE AND WHETHER THESE BEHAVIORS OCCUR 
AT THE RIGHT TIMES AND PLACES. 

(f) FUNCTIONAL ANALYSIS AND FUNCTIONAL RELATIONSHIPS 
ARE VERY USEFUL ASSESSMENT AND EVALUATION TOOLS. 
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T-15. 2.2(Ci 

STUDEMT Jim OBSERVER Mr. Rutherford, 

T5ACHER .Mr. Rutherford DATE 7/25/85 



SETTING: 9:25 Hath class; indepandent s«atifork; aath worksheets. 

Hr. Rutherford sitting mt desk at front of rooa. Jia 
sitting next to Ellen. 



TIME 



AHTECEDEXTS 



BEHAVIORS 



CONSEQUENCES 



9:27 



Ellen kicks 
Jia's chair. 



Jia kicks 
Ellen's chair. 



Mr. R. "Don't 
kick Ellen.* 



Hr. R. sends 

Jia to the 
office. 



9t2a 



Jia stoaps li 
troaps out of 
rooa. 



9.29 



iim vinks at Ellen vinks 
Ellen. back. 
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T-15. 2.2(b) 

TARGET STUDENT ' JIH 

SETTING - BATH CLASS; STUDENTS ENGAGED IN INDIVIDUAL SEATWORK. . . 

QUIETLY. HR. RUTHERFORD IS GRADING HIS PAPERS AMD 

'fSWERING A FACULTY MEMO ABOUT THE STAFF POTLUCK DINNER 
OH FRIDAY AFTERNOON. 

OBSERVATION EVEHTS - JIH la SITTIHG AT HIS DESK WITH THE TASK 
OF FINISHING HIS HATH WORKSHEETS. ELLEN, WHO IS 
SITTING NEXT TO JIH, HAS DECIDED THAT KICKING 
JIM'S CHAIR WOULD BE MORE ENTERTAIhlK^ THE RESULT 
IS THAT JIH BECOMES DISTRACTED AND REACTS BY KICKING 
ELLEN'S CHAIR. MR. RUTHERFORD'S ATTEKTION IS 
DIRECTED TO JIM WHO HE VERBALLY REPRIMANDS WITH "DON'T 
YOU BE KICKING ELLENll" AND WHO HE SENDS TO THE 
OFFICE TO SEE THE VICE PRINCIPAL. JIM STOMPS AND 
TROMPS OUT OF THE CLASSROOM, BUT NOT BEFORE HE WINKS AT 
ELLEK WHO WINKS BACK. 



ERIC 
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T-12. 3.3 

QlBESSIQiS QE SOCIAL lEflmQB 

TOPOGRAPHY 
LATENCY 
FREQUENCY 



LOCUS 



INTENSITY 



DURATION 



T-15. 2. 2 



STUDENT OBSERVER 

TEACHER DATE 



SETTINC- 



TIME ANTECEDENTS BEHAVIORS CONSEQUENCES 
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T-9.2.3(b) 
TASK ANALYSIS APPROACH TO ASSESSMENT 



MATERIAL 



IDENTIFY 



ACCURACY 



MASTERY 



AUTOMATICITY 



DIFFICULT 
SIMPLE 



T-12.2.2 

SQSUL SSIUiS m SSKUL 



BEHAVIOR EXCESSES 



BEHAVIOR DEFICITS 



BEHAVIOR ASSETS 



T-12. 3.2 

mi u As^i 



ERIC 



SETTING 
PRE-DISPOSINO FACTORS 

PRECIPITATING OR TRIGGERING F iCTORS 
CONTRIBUTING FACTORS 
TIME 

SOCIAL BEHAVIOR 
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T-a.4 

VALIDITY 
CONTENT VALIDITY 
CRITERION-RELATED VALIDITY 
CONSTRUCT VALIDITY 



T-9. 1. 1 

DIAGNOSIS OR WITHIN-STUDENT ASSESSMENT 
PEER COMPARISONS OR BETWEEN -STUDENT ASSESSMENT 
MASTER-DOMAIN OR STUDENT/CURRICULUM ASSESSMENT 
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CLEAR STATEMENT OP PURPOSE 



CLEAR COHHUNICATION OF PURPOSE OF TEST 



BIAS FREE 



T-8. 3. 2 



TEST-RETEST 



ALTERNATIVE-FORM RELIABILITY 



INTERNAL-CONSISTENCY RELIABILITY 
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LEVELS QE ^SESSflEHI 

LEVEL ONE: WRITTEN DOCUllENTS OR ARCHIVES 
LEVEL TWO: INTERVIEWS AND VERBAL REPORTS 
LEVEL THREE: FORMAL AND INFORMAL WRITTEN TESTS 
••••LEVEL FOUR: DIRECT OBSERVATIONAL DATA 



T-7.2 

ASSESSMENT GUIDELINES 
STEP ONE: DESCRIBE THE ASSESSMENT SITUATION 

STEP TWO: P^N THE TEST EXERCISE 

STEP THREE: DESCRIBE THE PERFORMANCE TO BE EVALUATED 

STEP FOUR: DESIGN A PUN FO^ RATING AND RECORDING PERFORHANCE 
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T-5.2 

ASSESSHENT AND EVALUATION 
ASSESfMRNT > THE MEASUREHENl DP SOME SET OP SKILLS. 



EVALUATION > THE DECISION-HAKING PROCESS THAT WE ENGAGE IN 

WHEN WE USE AMD ANALYZE STUDENT PERPORHANCE DATA. 



SUHHATIVE ASSESSMENT 

AND EVALUATION > MEASUREMENT AND AHAF.VSIS OP STUDENT 

LEARNING AGAINST A SPECIPIC LONG 
TERM OBJECTIVE AT THE BEGINNING AND 
THE END OP INSTRUCTION. 

PORMATIVE ASSESSMENT 

AND EVALUATION > THE CONTINUOUS MEASUREMENT AND ANALYSIS 

OP STUDENT LEARNING AND PERPORMANCE THROUGHOUT 
THE INSTRUCTIONAL PROCESS. 



T-5. 2.3(c) 

MEASURABLE BEHAVIORS AND EX.'ECTATIONS 
PUNCTIONAL MEASUREMENT PROCEDURES 
DIRECT MEASUREMENT OP INSTRUCTIONAL BEHAVIORS 
IMPLEMEf'^ABLE ON CONTINUOUS BASIS 
DATA-DECISION RULES 



gpj^ •IF-THEM" STATEMENTS 



o 



SIA6ES QE ;,EASl|ii!6 

ACOUISITIQH 
FLUENCY OR PROFICIENTY 
MAINTENANCE 
GENERALIZATION 
ADAPTATION 

T-4.1.2 

ASSESS 

2. SET LONG TERM OBJECTIVES 

3. SET SHORT TERN OBJECTIVES 

4. WRITE AN INSTRUCTIONAL PLAN 

5. WRITE A MEASUREMENT PLAN 
6. IMPLEMENT INSTRUCTIONAL AND MEASUREMENT PLAN 
7. HDDIPY BASED ON DATA 
a. EVALUATE 96 
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T-1. 1 

mm IHIEBYgy-QHIST tlimQh 

ACTIVE 
RESPONSIBLE 
FUNCTIONAL 
PERFORMANCE -BASED 



DYNAMIC 



T-2.1.3 



CRITICAL COHPOHEHTg OF TSg INSTBUCTigHAL gETTIHB 



STUDENT 



TEACHER 



SOCIAL ENVIRONMENT OF THE ADOLESCENT/YOUNG ADULT 
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on 



TNinilNG EVALUATION: 



C/SET HOOULE: DATE; 

TRAIHER: 

Please answer the following questions as honestly as you can. Your 
responses will be used for the following purposes: 

1. To assist trainers in evaluating training effectiveness. 

2. To assist in planning future training sessions. 

3. To assist in revising C/SET training modules. 

General Questions (Check One) 

1. Was your attendance at the session(s): 

a. by your own initiative to gain information on 

the topical areas? 

b. by your own initiative as respite from the classroom? 

c. a requirement you felt good about? 

d. a requirement you would rather not have had? f 

Coffinent f Optional): 



2. Training session(s) were: 

a. held at a convenient time and day of the week. 

b. held at a convenient time but not a convenient 

day of the K^ek. 

c. held at a poor tinie but on an appropriate day 

of the week. 

d. neither convenient as to time or day of the week. 

Coinnent (Ootional) 



Suggestions for better time and/or day (optional): 



ERIC 
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ASSESSMENT OF EXCEPTIONAL INDIVIDUAl 



3. How appropriate was the length of the training session(s)? 

much too long 

sotnewhat long 

just right 

somewhat short 

much too short 

Comment (Optional): 



Specific Questions (Check One) 

1. What is your overall reaction to the Information presented in 
the session(s) : 

I see little or no application 

I might apply It, but first I need more Information 

I might apply It, bxit first i need mor»- in-situation 

feedback and support 
I win apply it; it could result in an increased 

effectiveness 

I have applied It and have found It useful 

I have applied It and have found it to be Ineffective 

Conment (Optional): 



2. The Information pre:ented was: 
new and exciting 

the same old stuff with a different bend 

nothing new 

Conment (Optional): 



3. The presentor was: 

knowledgeable and interesting 

knowledgeable >et boring 

[ unSt-re about the content, yet Interesting 

unsure about the content and boring 

Comment: 
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AsJ^KT OF EXCEPTIONAL INDIVIDUALS: 



4. Media used in the session(s) was: 

very effective 
adequate 
poor 

Coiwient: 



5. What was the most important learning that resulted from the 
session(s)? 



6. What was disappointing about the session(s)? W^at did you neti 
or expect to learn that you didn't? 



7. What will you do differently in your classes as a result of the 
training session(s)? 



8. Other comments or suggestions: 



100 



TRAINING EVALUATION 



Please send completed evaluations to 

C. Michael Nelson, Ed.O. 
Department of Special Education 
University of Kentucky 
Lexington, KY 40506 



